mo a724615a9a feat(etl): Hadoop->Trino movement DAG + movements registry + autonomous ETL-agents ...

- DAG hadoop_to_trino (deployed to Airflow) + worker hadoop_to_trino.py (on the
  Hadoop master) move HDFS historical_sales -> iceberg.hadoop.historical_sales_hdfs.
- api/movements.py: movement registry, Airflow trigger+watch, run tracking
  (state/duration/rows), endpoints /api/movements, /{id}/run, /runs.
- agent_ops.py: ETL-agent loop autonomously triggers movements on an interval
  and logs each run; /api/agent-ops/etl/toggle + etl status.

2026-06-27 01:59:35 +02:00

..

agent_ops.py

feat(etl): Hadoop->Trino movement DAG + movements registry + autonomous ETL-agents

2026-06-27 01:59:35 +02:00

agent_terminal.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

approval_service.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

cdc_consumer.py

feat(cdc): live Debezium CDC consumer + /api/changes for the Changes dashboard

2026-06-27 01:31:18 +02:00

database_inventory.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

db.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

Dockerfile

feat(etl): Hadoop->Trino movement DAG + movements registry + autonomous ETL-agents

2026-06-27 01:59:35 +02:00

dockhand_envs.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

elasticsearch_api.py

Full stack visibility: mo S3 buckets, Elasticsearch/Kibana UI and topology

2026-06-25 00:53:11 +00:00

hadoop_analytics.py

feat(hadoop): real Hive engine + filterable, detailed analytics with lineage

2026-06-26 17:08:57 +00:00

hdfs_api.py

Add HDFS browser, SSH terminal, presentation editor, lab health panel

2026-06-26 00:47:49 +00:00

hive_bench_seed.json

feat(hadoop): real Hive engine + filterable, detailed analytics with lineage

2026-06-26 17:08:57 +00:00

lab_context.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

main.py

feat(etl): Hadoop->Trino movement DAG + movements registry + autonomous ETL-agents

2026-06-27 01:59:35 +02:00

movements.py

feat(etl): Hadoop->Trino movement DAG + movements registry + autonomous ETL-agents

2026-06-27 01:59:35 +02:00

node_ops.py

Add HDFS browser, SSH terminal, presentation editor, lab health panel

2026-06-26 00:47:49 +00:00

node_registry.py

Full stack visibility: mo S3 buckets, Elasticsearch/Kibana UI and topology

2026-06-25 00:53:11 +00:00

pipeline_ops.py

feat: neo4j in topology + agent-driven datagen with activity log; fix all-sources generate

2026-06-26 08:51:39 +00:00

presentation_static.py

Full stack visibility: mo S3 buckets, Elasticsearch/Kibana UI and topology

2026-06-25 00:53:11 +00:00

presentation_upload.py

Add HDFS browser, SSH terminal, presentation editor, lab health panel

2026-06-26 00:47:49 +00:00

presentation.py

Add HDFS browser, SSH terminal, presentation editor, lab health panel

2026-06-26 00:47:49 +00:00

requirements.txt

feat(cdc): live Debezium CDC consumer + /api/changes for the Changes dashboard

2026-06-27 01:31:18 +02:00

sql_console.py

Fix MySQL demo query for existing hr tables

2026-06-25 01:34:07 +00:00

ssh_terminal.py

Add HDFS browser, SSH terminal, presentation editor, lab health panel

2026-06-26 00:47:49 +00:00

storage_s3.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

supervisor.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

topology_views.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00

workload.py

Add Command Center v2: DQ/RAG integration, S3 browser, Jupyter, GPU matrix.

2026-06-25 00:28:23 +00:00