ATC/atc-agents
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • b54f5c7a06 feat: Nessie catalog UI + Iceberg structure explorer + live Data Flow online/offline main mo 2026-07-22 00:31:35 +00:00
  • d5fba208a3 Merge origin/main into running Command Center pre-nessie-2026-07-22 mo 2026-07-21 23:21:23 +00:00
  • 9008fbd512 feat: Authentik login + switchable GPU prod target mo 2026-07-21 23:20:24 +00:00
  • b46e7f01dd Fix Dockhand auth for topology flow and accurate CDC change stats. root 2026-07-01 15:14:48 +02:00
  • f36c8906bc feat(governance): close the 6 data-disease gaps — DQ monitoring, ownership, access posture, lineage & observability mo 2026-06-29 17:43:37 +00:00
  • d066def8b4 feat(cdc): add Re-sync sources button + auto-heal for Debezium connectors mo 2026-06-29 13:31:11 +00:00
  • 1e2cfe80f2 feat: live per-agent terminal activity with real scripts/SQL mo 2026-06-29 12:54:46 +00:00
  • b6d7d3dc74 feat: realtime ETL offload to S3 + live business dashboards mo 2026-06-28 23:33:21 +00:00
  • dfd5d4da8a feat: pulse generator edges on data gen + New & Changed Data dashboard mo 2026-06-28 22:41:48 +00:00
  • aa9ee66966 fix: Run control on Data Flow now starts the live data generator mo 2026-06-28 22:21:24 +00:00
  • 213350ec75 feat: Generate-data button + generation-script viewer + vector DB explorer mo 2026-06-28 22:06:27 +00:00
  • 9059006cc2 feat: continuous live generator + vLLM/RAG lane in Data Flow mo 2026-06-28 21:37:41 +00:00
  • 8c72d1dc63 feat: realtime Live dashboard in Data Explorer + fix panel layout mo 2026-06-28 21:10:19 +00:00
  • 437574f0bb feat: federated query spans all 5 databases (not just 3) mo 2026-06-28 18:51:55 +00:00
  • 28bdbaf13a feat: fold Trino federation into Data Explorer tabs; tidy sidebar mo 2026-06-28 18:33:16 +00:00
  • ea3e59cf9c feat: Trino federation + Hadoop external tables + LLM data catalog mo 2026-06-28 18:01:25 +00:00
  • 8d28695868 feat: Data Explorer tab + manual data entry with live CDC mo 2026-06-28 17:12:29 +00:00
  • 8a8d779328 search: index business entities + dataset quick-filters mo 2026-06-28 16:37:31 +00:00
  • 3a054ac13d Elasticsearch: full indexer, rich search UI, Kibana dashboards + shortcut mo 2026-06-28 13:23:27 +00:00
  • fcf85b0e4c Knowledge Chat: clickable pipeline steps with explanations + stronger live pulsing mo 2026-06-28 12:56:38 +00:00
  • f080c242de Knowledge Chat: spread pipeline nodes full-width, add self-hosted Trace Viewer + favicon mo 2026-06-28 12:48:52 +00:00
  • 03f300d46b Knowledge Chat: surface LangSmith trace link when tracing enabled (reads /rag/config) mo 2026-06-28 12:01:06 +00:00
  • 323acda6d4 Real-time RAG pipeline pulsing + prominent LangChain branding mo 2026-06-28 11:50:37 +00:00
  • f5c7227a97 feat(knowledge-chat): animated "How it works" RAG architecture panel mo 2026-06-28 11:36:21 +00:00
  • d05fe403a2 fix(datasources): MySQL browser race + slow row counts mo 2026-06-28 10:10:17 +00:00
  • 1432a8429a feat(storage): inline preview for json/csv/log/text files mo 2026-06-27 23:08:59 +00:00
  • a408ed4423 feat(storage): image gallery with thumbnails + lightbox mo 2026-06-27 22:59:50 +00:00
  • 930cd15f87 feat(storage): breadth-first analytics + recursive browse/search mo 2026-06-27 22:12:04 +00:00
  • 3a6ee8e2b0 feat(storage): rich Object Storage analytics dashboard mo 2026-06-27 21:30:45 +00:00
  • cdc8aa4bf7 feat(pii): masking for Cassandra & Neo4j (graph nodes + live property read) + MongoDB payload/free-text mo 2026-06-27 21:10:16 +00:00
  • e2ac114863 feat(pii): add masking toggle for Hadoop nodes + entity-identifier (quasi-PII) classification mo 2026-06-27 21:04:30 +00:00
  • 0bdc10ae78 feat(kafka): show Hadoop (HDFS3) sink connector in Kafka Connect panel mo 2026-06-27 20:53:58 +00:00
  • 46b9c50e73 feat: Spark Workbench everywhere, autonomous Hadoop offload & LLM masking-aware mo 2026-06-27 19:37:50 +00:00
  • 5828113f53 feat(ui): Neo4j graph explorer with interactive relationship visualization mo 2026-06-27 15:48:56 +00:00
  • a4c9b60079 feat(ui): Data Sources UI — enterprise browser for all 5 source databases mo 2026-06-27 15:42:37 +00:00
  • b8a5b10bc4 feat(openmetadata): populate Data Insights dashboard mo 2026-06-27 15:17:02 +00:00
  • 28821e8b04 feat(openmetadata): direct-API enrichment for real sample data, profiles & end-to-end lineage mo 2026-06-27 15:02:30 +00:00
  • 21af36a591 feat(openmetadata): profiler + data-quality tests for data insight mo 2026-06-27 14:55:48 +02:00
  • 8aa2324211 fix(openmetadata): relocate MySQL datadir to 32GB data disk mo 2026-06-27 13:48:49 +02:00
  • e8ff760cd1 feat(openmetadata): backfill Airflow task detail + dataset lineage mo 2026-06-27 13:30:08 +02:00
  • 79888dc617 feat(openmetadata): ingest Elasticsearch (search) + Airflow (pipelines) mo 2026-06-27 12:49:30 +02:00
  • b7965f98f4 fix(openmetadata): ES ingestion - disable self-signed cert verification (boolean) mo 2026-06-27 12:38:45 +02:00
  • 99ca01c4d9 chore(openmetadata): add inventory probe; full-stack ingestion verified (177 tables, +Kafka/S3/Superset) mo 2026-06-27 12:29:44 +02:00
  • b7dab19590 feat(openmetadata): ingest full stack - Trino all catalogs + Kafka, S3, Superset, ES mo 2026-06-27 12:25:51 +02:00
  • ca05e04f8c fix(dataflow): clean left-to-right stage layout for the topology mo 2026-06-27 12:07:25 +02:00
  • 05794906a7 perf(pii): native source-DB lookups for masking enforcement mo 2026-06-27 11:44:16 +02:00
  • 215ce111f1 feat(pii): self-service per-column masking policy enforced for the LLM mo 2026-06-27 11:36:36 +02:00
  • 9fb5b0a780 feat(llm): approval-gated movement executor + rag-api agent wiring + agent UI mo 2026-06-27 03:28:18 +02:00
  • 8263a03190 feat(llm): add governance context (CDC/movements/PII/lineage) to lab snapshot mo 2026-06-27 03:17:35 +02:00
  • c3cacc141d feat(masking): mask_to_curated DAG + OpenMetadata lineage + versioned OM artifacts mo 2026-06-27 03:13:16 +02:00
  • 944635ffe1 feat(masking): add PII columns to generators + backfill (Faker-style, no deps) mo 2026-06-27 02:50:28 +02:00
  • c70639c46d feat(dataflow): add OpenMetadata governance node + catalog edges + UI link mo 2026-06-27 02:43:22 +02:00
  • 3b247fa2bd feat(om): OpenMetadata integration — registry node, link, PII tag source mo 2026-06-27 02:40:27 +02:00
  • 6f20e24b8b feat(ui): Data Flow tab — live lineage graph + PII overlay + movement triggers mo 2026-06-27 02:09:38 +02:00
  • ee9357aa31 feat(dataflow): live Data Flow graph API + PII catalog mo 2026-06-27 02:04:46 +02:00
  • a724615a9a feat(etl): Hadoop->Trino movement DAG + movements registry + autonomous ETL-agents mo 2026-06-27 01:59:35 +02:00
  • 921342442f feat(ui): Live Changes (CDC) tab — real-time Debezium stream with filters, volume bars and before/after diff mo 2026-06-27 01:44:26 +02:00
  • 1a454f76cf feat(cdc): live Debezium CDC consumer + /api/changes for the Changes dashboard mo 2026-06-27 01:31:18 +02:00
  • 5147538b05 fix(agents): use in-memory PK pools for DML (avoid full-table scans on 54M-row tables) mo 2026-06-27 01:27:56 +02:00
  • 3c9661e7f9 feat(agents): autonomous guard-railed DML on source DBs for Debezium CDC mo 2026-06-27 01:25:08 +02:00
  • 96d490807a feat(hadoop): real Hive engine + filterable, detailed analytics with lineage mo 2026-06-26 17:08:57 +00:00
  • 71a64d5a21 feat(hadoop): embedded lakehouse analytics + Impala/Hive vs Trino comparison mo 2026-06-26 15:44:43 +00:00
  • 1147826dee fix(superset): disable Secure session cookie over HTTP so mo/bart can log in mo 2026-06-26 15:27:34 +00:00
  • 2d14eae55f feat(historical): offload historical_sales to S3 (Iceberg/Parquet on Dell ECS), repoint dashboard, drop Postgres copy mo 2026-06-26 11:38:30 +00:00
  • 8437ded990 topology: add direct source->Trino federated-query edges mo 2026-06-26 11:16:13 +00:00
  • 37c03b6881 feat(historical): durable Postgres-backed historical_sales + repoint Superset dashboard (no Trino downtime) mo 2026-06-26 09:43:21 +00:00
  • be2bbcbd92 feat(cdc): app-level Cassandra+Neo4j change events to Kafka (->S3) on generate mo 2026-06-26 09:21:17 +00:00
  • f4cd33b784 infra: historical sales -> iceberg.historical (Trino) + Superset dashboard scripts mo 2026-06-26 09:04:33 +00:00
  • 88ca338f5a feat: neo4j in topology + agent-driven datagen with activity log; fix all-sources generate mo 2026-06-26 08:51:39 +00:00
  • 9cbdccb403 infra: fix mongodb uuid encoding + combined DAG honors rows conf mo 2026-06-26 08:41:44 +00:00
  • 897ccaa9f3 api: non-blocking /sync via background refresher (full-scan counts cached) mo 2026-06-26 01:39:53 +00:00
  • d26698a0c7 infra: hadoop historical sales loader (HDFS partitioned by year) mo 2026-06-26 01:26:43 +00:00
  • 2f2cecd16f infra: neo4j generator creates indexes for fast relationship MERGE mo 2026-06-26 01:24:56 +00:00
  • 89b31c680a infra: fix cassandra (prepared stmt) + neo4j (drop APOC, grouped MERGE) generators mo 2026-06-26 01:24:06 +00:00
  • be526bb0e3 ui: Data Generation view (per-DB tabs, light generate, run status) + topology pulse mo 2026-06-26 01:17:51 +00:00
  • bac3a90775 api: pipeline_ops router (per-source generate trigger, run status, Trino sync counts) mo 2026-06-26 01:12:07 +00:00
  • 62b416d210 infra: mirror light per-source Airflow DAGs + generators (GEN_ROWS), fix script path mo 2026-06-26 01:07:23 +00:00
  • 9400f9410c Add scripts/save.sh helper for commit+push per change mo 2026-06-26 00:48:11 +00:00
  • 46b51a891c Add HDFS browser, SSH terminal, presentation editor, lab health panel mo 2026-06-26 00:47:49 +00:00
  • fefe3016ad Fix dangling topology edge by routing wide ETL paths below intermediate nodes mo 2026-06-25 10:12:43 +00:00
  • ff2c31a6b5 Fix remaining Dutch string in DataQualityView mo 2026-06-25 10:00:07 +00:00
  • 41a8a3b18e Resizable workbench with proper scroll and fix chat message contrast. mo 2026-06-25 01:42:25 +00:00
  • 4ff9f5589e Fix MySQL demo query for existing hr tables mo 2026-06-25 01:34:07 +00:00
  • 7da2dd60f0 Add MySQL/MongoDB consoles, fit topology without scroll, longer flow lines. mo 2026-06-25 01:33:48 +00:00
  • 4e1cf9ef6c Use equivalent 5M sin benchmark query on Trino mo 2026-06-25 01:24:58 +00:00
  • 2cf90c9e14 Fix Trino benchmark and sample queries for valid syntax and parallel demo mo 2026-06-25 01:24:35 +00:00
  • 170eb2418b Add agent workbench terminal and live PostgreSQL/Trino SQL consoles. mo 2026-06-25 01:10:57 +00:00
  • d4538a002f ES/Kibana login: admin or elastic via lab credentials mo 2026-06-25 00:59:16 +00:00
  • c9faa517d1 Document Elasticsearch firewall rules for lab subnets mo 2026-06-25 00:56:38 +00:00
  • 9deda7fcb1 Full stack visibility: mo S3 buckets, Elasticsearch/Kibana UI and topology mo 2026-06-25 00:53:11 +00:00
  • 4a5aed21ee Point env_file to visible atc.env mo 2026-06-25 00:45:58 +00:00
  • 5320af2e60 Use visible atc.env instead of hidden .env for configuration mo 2026-06-25 00:45:44 +00:00
  • a11621b21f Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix. mo 2026-06-25 00:28:23 +00:00
  • fb9cc21c9a Add ATC Command Center v1 with light UI theme. mo 2026-06-23 15:07:51 +02:00