21 lines
1.2 KiB
Markdown
21 lines
1.2 KiB
Markdown
|
# Model catalog (VM303)
|
||
|
|
|
||
|
|
| ID | Name | Runtime | Backend | V100 |
|
||
|
|
|---|---|---|---|---|
|
||
|
|
| `llama3-70b-gptq` | Llama 3 70B GPTQ | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `qwen25-coder-32b-gptq` | Qwen 2.5 Coder 32B GPTQ | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `qwen25-32b-gptq` | Qwen 2.5 32B GPTQ | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `deepseek-coder-33b-gptq` | DeepSeek Coder 33B GPTQ | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `qwen25-coder-7b` | Qwen 2.5 Coder 7B | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `deepseek-coder-6.7b` | DeepSeek Coder 6.7B | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `deepseek-coder-7b` | DeepSeek Coder 7B v1.5 | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `starcoder2-15b` | StarCoder2 15B | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `granite-code-8b` | IBM Granite Code 8B | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `yi-coder-9b` | Yi-Coder 9B | vllm-legacy-040 | vllm | yes |
|
||
|
|
| `deepseek-coder-v2-lite` | DeepSeek Coder V2 Lite | vllm-modern-080 | vllm | yes |
|
||
|
|
| `qwen3-coder-next` | Qwen3 Coder Next | vllm-modern-080 | vllm | yes |
|
||
|
|
| `qwen3-coder-30b` | Qwen3 Coder 30B A3B | vllm-modern-080 | vllm | yes |
|
||
|
|
| `qwen36-27b` | Qwen 3.6 27B | sglang-modern | sglang | yes |
|
||
|
|
| `qwen36-27b-awq` | Qwen 3.6 27B AWQ | sglang-modern | sglang | yes |
|
||
|
|
| `codellama-34b` | Code Llama 34B | vllm-legacy-040 | vllm | yes |
|