Files
mo c154c94c6d Add GPU Lab configs, docs, and runbooks for VM303.
Mirror gpu-lab compose files and model-manager catalog from GPU-Dev; document Dockhand mapping and SGLang cutover target.
2026-06-04 02:24:57 +02:00

1.2 KiB

Model catalog (VM303)

ID Name Runtime Backend V100
llama3-70b-gptq Llama 3 70B GPTQ vllm-legacy-040 vllm yes
qwen25-coder-32b-gptq Qwen 2.5 Coder 32B GPTQ vllm-legacy-040 vllm yes
qwen25-32b-gptq Qwen 2.5 32B GPTQ vllm-legacy-040 vllm yes
deepseek-coder-33b-gptq DeepSeek Coder 33B GPTQ vllm-legacy-040 vllm yes
qwen25-coder-7b Qwen 2.5 Coder 7B vllm-legacy-040 vllm yes
deepseek-coder-6.7b DeepSeek Coder 6.7B vllm-legacy-040 vllm yes
deepseek-coder-7b DeepSeek Coder 7B v1.5 vllm-legacy-040 vllm yes
starcoder2-15b StarCoder2 15B vllm-legacy-040 vllm yes
granite-code-8b IBM Granite Code 8B vllm-legacy-040 vllm yes
yi-coder-9b Yi-Coder 9B vllm-legacy-040 vllm yes
deepseek-coder-v2-lite DeepSeek Coder V2 Lite vllm-modern-080 vllm yes
qwen3-coder-next Qwen3 Coder Next vllm-modern-080 vllm yes
qwen3-coder-30b Qwen3 Coder 30B A3B vllm-modern-080 vllm yes
qwen36-27b Qwen 3.6 27B sglang-modern sglang yes
qwen36-27b-awq Qwen 3.6 27B AWQ sglang-modern sglang yes
codellama-34b Code Llama 34B vllm-legacy-040 vllm yes