# atc-GPU — GPU Lab Infrastructure

Infrastructure-as-code and documentation for the ATC GPU Lab environment on **VM303 (GPU-Dev)**.

## Quick links

| Service | URL |
|---------|-----|
| GPU Lab UI | http://10.0.20.106:9000/ |
| Inference API (active runtime) | http://10.0.20.106:8010/v1/models |
| OpenAI gateway | http://10.0.20.106:8001/v1/models |
| Dockhand (GPU-Dev env) | http://atc-docker01.dell-atc.lan:8082/ |

## Repository layout

```
atc-GPU/
├── README.md
├── docs/           # Landscape, models, runbooks, Dockhand mapping
├── config/         # gpu-lab compose + model-manager catalog (no secrets)
├── compose/        # Dockhand-safe compose variants
└── scripts/        # Helper scripts (activate-model)
```

## Active target (2026-06)

- **Runtime:** SGLang (`sglang-modern`) via `compose.sglang.yml`
- **Model:** Qwen 3.6 27B AWQ (`qwen36-27b-awq` → served as `qwen3.6-27b-awq`)
- **Previous:** Llama3-70b-GPTQ on vLLM legacy (to be decommissioned after cutover)

See [docs/runbook-vm303.md](docs/runbook-vm303.md) for activate/rollback steps.

## Related repos

- [mo/Lakehouse](http://atc-mgt01.dell-atc.lan:3001/mo/Lakehouse) — Spark, Trino, Debezium, Airflow, S3 pipeline