c154c94c6d
Mirror gpu-lab compose files and model-manager catalog from GPU-Dev; document Dockhand mapping and SGLang cutover target.
1.2 KiB
1.2 KiB
Model catalog (VM303)
| ID | Name | Runtime | Backend | V100 |
|---|---|---|---|---|
llama3-70b-gptq |
Llama 3 70B GPTQ | vllm-legacy-040 | vllm | yes |
qwen25-coder-32b-gptq |
Qwen 2.5 Coder 32B GPTQ | vllm-legacy-040 | vllm | yes |
qwen25-32b-gptq |
Qwen 2.5 32B GPTQ | vllm-legacy-040 | vllm | yes |
deepseek-coder-33b-gptq |
DeepSeek Coder 33B GPTQ | vllm-legacy-040 | vllm | yes |
qwen25-coder-7b |
Qwen 2.5 Coder 7B | vllm-legacy-040 | vllm | yes |
deepseek-coder-6.7b |
DeepSeek Coder 6.7B | vllm-legacy-040 | vllm | yes |
deepseek-coder-7b |
DeepSeek Coder 7B v1.5 | vllm-legacy-040 | vllm | yes |
starcoder2-15b |
StarCoder2 15B | vllm-legacy-040 | vllm | yes |
granite-code-8b |
IBM Granite Code 8B | vllm-legacy-040 | vllm | yes |
yi-coder-9b |
Yi-Coder 9B | vllm-legacy-040 | vllm | yes |
deepseek-coder-v2-lite |
DeepSeek Coder V2 Lite | vllm-modern-080 | vllm | yes |
qwen3-coder-next |
Qwen3 Coder Next | vllm-modern-080 | vllm | yes |
qwen3-coder-30b |
Qwen3 Coder 30B A3B | vllm-modern-080 | vllm | yes |
qwen36-27b |
Qwen 3.6 27B | sglang-modern | sglang | yes |
qwen36-27b-awq |
Qwen 3.6 27B AWQ | sglang-modern | sglang | yes |
codellama-34b |
Code Llama 34B | vllm-legacy-040 | vllm | yes |