Add GPU Lab configs, docs, and runbooks for VM303.

Mirror gpu-lab compose files and model-manager catalog from GPU-Dev; document Dockhand mapping and SGLang cutover target.
This commit is contained in:
mo
2026-06-04 02:24:57 +02:00
parent 26aec9ed04
commit c154c94c6d
14 changed files with 930 additions and 2 deletions
+34 -2
View File
@@ -1,3 +1,35 @@
# atc-GPU
# atc-GPU — GPU Lab Infrastructure
GPU Lab infrastructure — VM303 model-manager, gpu-lab Docker stacks, Dockhand
Infrastructure-as-code and documentation for the ATC GPU Lab environment on **VM303 (GPU-Dev)**.
## Quick links
| Service | URL |
|---------|-----|
| GPU Lab UI | http://10.0.20.106:9000/ |
| Inference API (active runtime) | http://10.0.20.106:8010/v1/models |
| OpenAI gateway | http://10.0.20.106:8001/v1/models |
| Dockhand (GPU-Dev env) | http://atc-docker01.dell-atc.lan:8082/ |
## Repository layout
```
atc-GPU/
├── README.md
├── docs/ # Landscape, models, runbooks, Dockhand mapping
├── config/ # gpu-lab compose + model-manager catalog (no secrets)
├── compose/ # Dockhand-safe compose variants
└── scripts/ # Helper scripts (activate-model)
```
## Active target (2026-06)
- **Runtime:** SGLang (`sglang-modern`) via `compose.sglang.yml`
- **Model:** Qwen 3.6 27B AWQ (`qwen36-27b-awq` → served as `qwen3.6-27b-awq`)
- **Previous:** Llama3-70b-GPTQ on vLLM legacy (to be decommissioned after cutover)
See [docs/runbook-vm303.md](docs/runbook-vm303.md) for activate/rollback steps.
## Related repos
- [mo/Lakehouse](http://atc-mgt01.dell-atc.lan:3001/mo/Lakehouse) — Spark, Trino, Debezium, Airflow, S3 pipeline