46b9c50e73
feat: Spark Workbench everywhere, autonomous Hadoop offload & LLM masking-aware
...
- Data Hub with Hadoop tab (HDFS/Iceberg browser, Spark, pipeline)
- Databricks-style Lakehouse Workbench (Trino engine, live exec matrix,
materialize to Iceberg/S3); reused & embedded in every source-DB UI
- HDFS -> Kafka -> Spark -> Iceberg/S3 pipeline; WebHDFS hostname resolver
- Data Flow master pulse switch (Run/Pause/Stop) gating animated edges
- Data Custodian autonomous Hadoop offload loop (batch counterpart to CDC),
pulsing source -> HDFS edges; toggle in Data Flow
- LLM now autonomously aware of all latest platform changes (live platform
context) and enforces masking policy: never reveals masked PII, still
answers helpfully with aggregates/explanations
2026-06-27 19:37:50 +00:00
a4c9b60079
feat(ui): Data Sources UI — enterprise browser for all 5 source databases
...
New "Data Sources UI" tab with per-database Browser (catalog + sample data),
Query Console (SqlWorkbench) and embedded interactive Shell (DbShell via SSH).
Backend:
- Extend sql_console.py with Cassandra (CQL) + Neo4j (Cypher) engines
- Add GET /api/sql/catalog/{engine} and GET /api/sql/sample/{engine}
- ssh_terminal: optional initial_command for auto-launching DB CLIs
Frontend:
- DataSourcesView with 5-DB rail, health dots, Browser/Console/Shell sub-tabs
- DbShell embedded xterm terminal with docker exec CLI per engine
- Deep-link topology DB nodes to Data Sources UI (no SQL dock on platform)
- WorkbenchPanel restricted to agent mode only — frees dashboard space
2026-06-27 15:42:37 +00:00
6f20e24b8b
feat(ui): Data Flow tab — live lineage graph + PII overlay + movement triggers
...
New DataFlowView (topology-style): nodes positioned from /api/dataflow with
measured-anchor SVG edges and animated particles (active CDC + running
movements). PII overlay shows shield badges + per-column detail inspector.
Bottom strip triggers ETL movements and toggles the ETL agent. Wired into
SideNav (Data Flow) and App routing; added types + api helpers.
2026-06-27 02:09:38 +02:00
921342442f
feat(ui): Live Changes (CDC) tab — real-time Debezium stream with filters, volume bars and before/after diff
2026-06-27 01:44:26 +02:00
be526bb0e3
ui: Data Generation view (per-DB tabs, light generate, run status) + topology pulse
2026-06-26 01:17:51 +00:00
46b51a891c
Add HDFS browser, SSH terminal, presentation editor, lab health panel
...
- HDFS WebHDFS file browser (api/hdfs_api.py + HdfsView)
- In-browser SSH terminal via paramiko WebSocket bridge (api/ssh_terminal.py + SshTerminal, xterm.js)
- Presentation deck editor (text + image upload) and CRUD endpoints
- Collapsible GPU matrix + new LabHealthPanel in SideNav
- Topology fixes (edge alignment, Hadoop node, compact nodes)
- nginx ws timeout bump for long-lived SSH sessions
2026-06-26 00:47:49 +00:00
7da2dd60f0
Add MySQL/MongoDB consoles, fit topology without scroll, longer flow lines.
...
Compact workbench panel, collapsible infra bar, narrower topology nodes with wider inter-stage gaps for visible connection lines.
2026-06-25 01:33:48 +00:00
170eb2418b
Add agent workbench terminal and live PostgreSQL/Trino SQL consoles.
...
Clicking agents opens a dedicated terminal panel; topology PostgreSQL/Trino nodes open SQL workbench with ten demo queries and Postgres vs Trino benchmark.
2026-06-25 01:10:57 +00:00
9deda7fcb1
Full stack visibility: mo S3 buckets, Elasticsearch/Kibana UI and topology
2026-06-25 00:53:11 +00:00
a11621b21f
Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.
...
Mirror mo/atc-GPU layout with config/, docs/, scripts/ for Gitea deploy.
2026-06-25 00:28:23 +00:00
fb9cc21c9a
Add ATC Command Center v1 with light UI theme.
...
Agent hub dashboard, FastAPI backend, and Docker stack for VM 304 MCP.
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-23 15:07:51 +02:00
mo