71a64d5a21
feat(hadoop): embedded lakehouse analytics + Impala/Hive vs Trino comparison
...
Adds an Analytics sub-tab to the Hadoop view with live KPIs and revenue
breakdowns (by year/region/category/channel) queried from Trino over
iceberg.hadoop.historical_sales, plus a query-engine comparison panel. Trino
latency is measured live; Impala and Hive are shown as clearly-labelled
representative figures (those engines are not deployed). New cached endpoints
/api/hadoop/analytics and /api/hadoop/engines.
2026-06-26 15:44:43 +00:00
1147826dee
fix(superset): disable Secure session cookie over HTTP so mo/bart can log in
...
Talisman forced Secure on the session cookie while Superset is served over
plain HTTP, so browsers never returned the cookie and every login failed CSRF
validation ("CSRF session token is missing"). Set session_cookie_secure=False
(+ SESSION_COOKIE_SECURE/WTF_CSRF_SSL_STRICT). Also rename S3 lakehouse prefix
iceberg-warehouse -> hadoop (Trino iceberg.hadoop.historical_sales) and repoint
the Superset dataset. Adds sanitized infra backup scripts.
2026-06-26 15:27:34 +00:00
2d14eae55f
feat(historical): offload historical_sales to S3 (Iceberg/Parquet on Dell ECS), repoint dashboard, drop Postgres copy
2026-06-26 11:38:30 +00:00
8437ded990
topology: add direct source->Trino federated-query edges
2026-06-26 11:16:13 +00:00
37c03b6881
feat(historical): durable Postgres-backed historical_sales + repoint Superset dashboard (no Trino downtime)
2026-06-26 09:43:21 +00:00
be2bbcbd92
feat(cdc): app-level Cassandra+Neo4j change events to Kafka (->S3) on generate
2026-06-26 09:21:17 +00:00
f4cd33b784
infra: historical sales -> iceberg.historical (Trino) + Superset dashboard scripts
2026-06-26 09:04:33 +00:00
88ca338f5a
feat: neo4j in topology + agent-driven datagen with activity log; fix all-sources generate
2026-06-26 08:51:39 +00:00
9cbdccb403
infra: fix mongodb uuid encoding + combined DAG honors rows conf
2026-06-26 08:41:44 +00:00
897ccaa9f3
api: non-blocking /sync via background refresher (full-scan counts cached)
2026-06-26 01:39:53 +00:00
d26698a0c7
infra: hadoop historical sales loader (HDFS partitioned by year)
2026-06-26 01:26:43 +00:00
2f2cecd16f
infra: neo4j generator creates indexes for fast relationship MERGE
2026-06-26 01:24:56 +00:00
89b31c680a
infra: fix cassandra (prepared stmt) + neo4j (drop APOC, grouped MERGE) generators
2026-06-26 01:24:06 +00:00
be526bb0e3
ui: Data Generation view (per-DB tabs, light generate, run status) + topology pulse
2026-06-26 01:17:51 +00:00
bac3a90775
api: pipeline_ops router (per-source generate trigger, run status, Trino sync counts)
2026-06-26 01:12:07 +00:00
62b416d210
infra: mirror light per-source Airflow DAGs + generators (GEN_ROWS), fix script path
2026-06-26 01:07:23 +00:00
9400f9410c
Add scripts/save.sh helper for commit+push per change
2026-06-26 00:48:11 +00:00
46b51a891c
Add HDFS browser, SSH terminal, presentation editor, lab health panel
...
- HDFS WebHDFS file browser (api/hdfs_api.py + HdfsView)
- In-browser SSH terminal via paramiko WebSocket bridge (api/ssh_terminal.py + SshTerminal, xterm.js)
- Presentation deck editor (text + image upload) and CRUD endpoints
- Collapsible GPU matrix + new LabHealthPanel in SideNav
- Topology fixes (edge alignment, Hadoop node, compact nodes)
- nginx ws timeout bump for long-lived SSH sessions
2026-06-26 00:47:49 +00:00
fefe3016ad
Fix dangling topology edge by routing wide ETL paths below intermediate nodes
2026-06-25 10:12:43 +00:00
ff2c31a6b5
Fix remaining Dutch string in DataQualityView
2026-06-25 10:00:07 +00:00
41a8a3b18e
Resizable workbench with proper scroll and fix chat message contrast.
...
Workbench drag handle for SQL/agent panels; dark-theme user bubbles and input field readable.
2026-06-25 01:42:25 +00:00
4ff9f5589e
Fix MySQL demo query for existing hr tables
2026-06-25 01:34:07 +00:00
7da2dd60f0
Add MySQL/MongoDB consoles, fit topology without scroll, longer flow lines.
...
Compact workbench panel, collapsible infra bar, narrower topology nodes with wider inter-stage gaps for visible connection lines.
2026-06-25 01:33:48 +00:00
4e1cf9ef6c
Use equivalent 5M sin benchmark query on Trino
2026-06-25 01:24:58 +00:00
2cf90c9e14
Fix Trino benchmark and sample queries for valid syntax and parallel demo
2026-06-25 01:24:35 +00:00
170eb2418b
Add agent workbench terminal and live PostgreSQL/Trino SQL consoles.
...
Clicking agents opens a dedicated terminal panel; topology PostgreSQL/Trino nodes open SQL workbench with ten demo queries and Postgres vs Trino benchmark.
2026-06-25 01:10:57 +00:00
d4538a002f
ES/Kibana login: admin or elastic via lab credentials
2026-06-25 00:59:16 +00:00
c9faa517d1
Document Elasticsearch firewall rules for lab subnets
2026-06-25 00:56:38 +00:00
9deda7fcb1
Full stack visibility: mo S3 buckets, Elasticsearch/Kibana UI and topology
2026-06-25 00:53:11 +00:00
4a5aed21ee
Point env_file to visible atc.env
2026-06-25 00:45:58 +00:00
5320af2e60
Use visible atc.env instead of hidden .env for configuration
2026-06-25 00:45:44 +00:00
a11621b21f
Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.
...
Mirror mo/atc-GPU layout with config/, docs/, scripts/ for Gitea deploy.
2026-06-25 00:28:23 +00:00
fb9cc21c9a
Add ATC Command Center v1 with light UI theme.
...
Agent hub dashboard, FastAPI backend, and Docker stack for VM 304 MCP.
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-23 15:07:51 +02:00
mo