ATC/atc-agents
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: Spark Workbench everywhere, autonomous Hadoop offload & LLM masking-aware

Browse Source 
- Data Hub with Hadoop tab (HDFS/Iceberg browser, Spark, pipeline)
- Databricks-style Lakehouse Workbench (Trino engine, live exec matrix,
  materialize to Iceberg/S3); reused & embedded in every source-DB UI
- HDFS -> Kafka -> Spark -> Iceberg/S3 pipeline; WebHDFS hostname resolver
- Data Flow master pulse switch (Run/Pause/Stop) gating animated edges
- Data Custodian autonomous Hadoop offload loop (batch counterpart to CDC),
  pulsing source -> HDFS edges; toggle in Data Flow
- LLM now autonomously aware of all latest platform changes (live platform
  context) and enforces masking policy: never reveals masked PII, still
  answers helpfully with aggregates/explanations
This commit is contained in:
mo
2026-06-27 19:37:50 +00:00
parent 5828113f53
commit 46b9c50e73
39 changed files with 5476 additions and 725 deletions
Download Patch File Download Diff File Expand all files Collapse all files
ui/src/styles/globals.css
+6 -6
View File
@@ -11,9 +11,9 @@
--surface-muted: 221 225 230;
--border: 210 218 228;
--border-strong: 180 192 208;
--foreground: 26 31 38;
--foreground-muted: 95 107 122;
--foreground-faint: 139 149 165;
--foreground: 12 18 28;
--foreground-muted: 38 48 62;
--foreground-faint: 62 72 88;
--shadow-panel: 0 1px 3px rgba(15, 40, 80, 0.06), 0 4px 12px rgba(36, 150, 237, 0.06);
--shadow-docker: 0 0 0 1px rgba(36, 150, 237, 0.12), 0 4px 14px rgba(36, 150, 237, 0.1);
--topo-canvas: linear-gradient(145deg, #dbeafe 0%, #e0f2fe 35%, #ede9fe 70%, #ecfdf5 100%);
@@ -33,9 +33,9 @@
--surface-muted: 36 58 92;
--border: 48 74 112;
--border-strong: 64 96 140;
--foreground: 232 241 255;
--foreground-muted: 148 175 212;
--foreground-faint: 100 130 168;
--foreground: 255 255 255;
--foreground-muted: 228 234 244;
--foreground-faint: 195 205 220;
--shadow-panel: 0 1px 0 rgba(147, 197, 253, 0.06) inset, 0 8px 24px rgba(0, 0, 0, 0.35);
--shadow-docker: 0 0 0 1px rgba(56, 189, 248, 0.2), 0 4px 16px rgba(14, 116, 214, 0.25);
--topo-canvas: linear-gradient(145deg, #0c1929 0%, #132f4c 40%, #1a365d 75%, #0f2847 100%);