ATC/atc-GPU
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add GPU Lab configs, docs, and runbooks for VM303.

Browse Source 
Mirror gpu-lab compose files and model-manager catalog from GPU-Dev; document Dockhand mapping and SGLang cutover target.
This commit is contained in:
mo
2026-06-04 02:24:57 +02:00
parent 26aec9ed04
commit c154c94c6d
14 changed files with 930 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/models.md
+20
View File
@@ -0,0 +1,20 @@
# Model catalog (VM303)
| ID | Name | Runtime | Backend | V100 |
|---|---|---|---|---|
| `llama3-70b-gptq` | Llama 3 70B GPTQ | vllm-legacy-040 | vllm | yes |
| `qwen25-coder-32b-gptq` | Qwen 2.5 Coder 32B GPTQ | vllm-legacy-040 | vllm | yes |
| `qwen25-32b-gptq` | Qwen 2.5 32B GPTQ | vllm-legacy-040 | vllm | yes |
| `deepseek-coder-33b-gptq` | DeepSeek Coder 33B GPTQ | vllm-legacy-040 | vllm | yes |
| `qwen25-coder-7b` | Qwen 2.5 Coder 7B | vllm-legacy-040 | vllm | yes |
| `deepseek-coder-6.7b` | DeepSeek Coder 6.7B | vllm-legacy-040 | vllm | yes |
| `deepseek-coder-7b` | DeepSeek Coder 7B v1.5 | vllm-legacy-040 | vllm | yes |
| `starcoder2-15b` | StarCoder2 15B | vllm-legacy-040 | vllm | yes |
| `granite-code-8b` | IBM Granite Code 8B | vllm-legacy-040 | vllm | yes |
| `yi-coder-9b` | Yi-Coder 9B | vllm-legacy-040 | vllm | yes |
| `deepseek-coder-v2-lite` | DeepSeek Coder V2 Lite | vllm-modern-080 | vllm | yes |
| `qwen3-coder-next` | Qwen3 Coder Next | vllm-modern-080 | vllm | yes |
| `qwen3-coder-30b` | Qwen3 Coder 30B A3B | vllm-modern-080 | vllm | yes |
| `qwen36-27b` | Qwen 3.6 27B | sglang-modern | sglang | yes |
| `qwen36-27b-awq` | Qwen 3.6 27B AWQ | sglang-modern | sglang | yes |
| `codellama-34b` | Code Llama 34B | vllm-legacy-040 | vllm | yes |