mo
1e2cfe80f2
Agent terminals were idle (one-shot probe) while agents were busy in the background. Now every agent streams what it is actually doing: - agent_terminal: emit_threadsafe() so background threads can stream lines. - agent_ops: Data Custodian DML loop logs the real INSERT/UPDATE/DELETE SQL (+ Mongo ops) and Hadoop-offload Trino CTAS/INSERT to its terminal; ETL Guardian announces each orchestrated movement. - movements: trigger_and_watch streams the Airflow DAG / API call, conf, before/after Trino counts and result to the owning agent terminal. - etl_offload: per-dataset read + pyarrow->S3 parquet writes and cycle summaries stream to the ETL Guardian terminal. - agent_activity (new): round-robin live probes for Lakehouse Ops, Hadoop Ranger (NameNode JMX + YARN), Infra Sentinel (Dockhand inventory + host load) and Network Watcher (VLAN 20/21 path checks). - fix: YARN ResourceManager runs on 10.0.21.62:8088 (was .61). - ui: terminal dock merges the selected agent ops stream with the node probe.
ATC Command Center
Autonomous agent hub for the Dell ATC lab — Ops Floor UI, FastAPI backend, 5 operator agents.
Quick start
docker compose up -d --build
Open: http://10.0.21.33/
Stack
- ui — React dashboard + operator sprites (cap + headset)
- api — FastAPI (status, feed, prompts, WebSocket)
- redis — live event bus
- caddy — reverse proxy (:80)
VM 304 (MCP)
- IP:
10.0.21.33(DHCP on VLAN 20 /br_20) - Proxmox VMID 304 on atc-gpu
- SSH:
root/Dell2026!
Gitea
http://atc-mgt01.dell-atc.lan:3001/mo/atc-agents
ATC Command Center — Gitea layout
This repo follows the same pattern as mo/atc-GPU and mo/Lakehouse.
Related repos (Gitea @ atc-mgt01:3001)
| Repo | Path on VM304 | Purpose |
|---|---|---|
| mo/atc-agents | /opt/atc-agents |
Command Center UI + API + docker-compose |
| mo/atc-data-quality | /opt/atc-data-quality |
DQ API + RAG API |
| mo/atc-GPU | GPU lab VM303 | vLLM, model-manager |
| mo/Lakehouse | lake01 / docker hosts | Kafka, Spark, Trino, ObjectScale config |
This repo structure
atc-agents/
├── api/ FastAPI backend
├── ui/ React dashboard
├── caddy/ Reverse proxy routes
├── config/ Deploy reference (mirrors production)
│ ├── command-center/ docker-compose, Caddyfile, .env.example
│ ├── data-quality/ Link to mo/atc-data-quality
│ └── jupyter/ JupyterLab service snippet
├── docs/ Runbooks
├── scripts/ deploy.sh
└── docker-compose.yml Production stack (clone with atc-data-quality sibling)
Deploy
git clone http://atc-mgt01.dell-atc.lan:3001/mo/atc-agents.git /opt/atc-agents
git clone http://atc-mgt01.dell-atc.lan:3001/mo/atc-data-quality.git /opt/atc-data-quality
cp config/command-center/.env.example /opt/atc-agents/.env # edit secrets
./scripts/deploy.sh
Open: http://10.0.21.33/
Services (port 80 via Caddy)
| Route | Service |
|---|---|
/ |
React UI |
/api/* |
Agents API |
/dq/* |
Data Quality API |
/rag/* |
Knowledge Chat / RAG |
/jupyter/* |
JupyterLab (S3 env preconfigured) |
:5001 |
Docling UI (direct) |