Benchmarks / BM-002
BM-002 · TESTED 2026-07-26
Qwen3-Coder-30B-A3B: NVIDIA CUDA vs. Arc Vulkan at Q4_K_M
SUPERSEDED 2026-07-18 — see bm-009. Provisional Victor numbers in this record were ~3x too slow (real: 172 tok/s gen, 3403 tok/s prompt) and based on an incorrect single-24GB-GPU hardware spec. Retained for history only; do not cite. The original summary read: 'CUDA on the NVIDIA reference produces 52.1 tok/s vs. 38.6 tok/s on Arc Vulkan — a 35% generation-speed lead at the same 24GB VRAM tier.'
cuda · q4-k-m · llama.cpp b3500 (CUDA 12.5)
Configuration
- Artifact
- Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf
- Author
- Edgar
- Backend
- cuda
- Checksum
- sha256:pending-real-checksum
- Context length
- 8192 tokens
- Model
- Qwen3-Coder-30B-A3B-Instruct
- Quantization
- q4-k-m
- Runtime
- llama.cpp b3500 (CUDA 12.5)
- Settings
- -ngl 99 -c 8192 -t 8 -b 512
- Workload pack
- workload-pack-v1
Results
Same workload pack as bm-001 to enable direct comparison.
| MACHINE | PROMPT tok/s | GEN tok/s | TTFT ms | VRAM GB | RAM GB | POWER W |
|---|---|---|---|---|---|---|
| Victor (msi-command) NVIDIA CUDA reference. cuBLAS, standard memory pool. | 612.4 | 52.1 | 410 | 18.0 | 2.8 | 285 |
| Jitori PC Arc B60 Pro, Vulkan. Reference from bm-001. | 412.3 | 38.6 | 740 | 18.1 | 3.2 | 245 |
Quality scores
coding
0.81 / 0-1
HumanEval pass@1
Limitations
- Victor configuration is provisional pending identity confirmation (see blueprint Appendix A1).
- CUDA version pinned to 12.5; cuBLAS behavior varies across minor versions.
- Identical model artifact and quant to bm-001 to isolate the backend variable.
Corrections
2026-07-18: SUPERSEDED by bm-009. The Victor numbers in this record (gen 52.1 tok/s, prompt 612.4 tok/s, vram 18.0GB on a claimed single 24GB card at CUDA 12.5) were provisional placeholders and are incorrect. Real measurements on the actual hardware (MSI Vector 16 HX laptop, 2x RTX 5070-class mobile GPUs, CUDA 13.3) are ~3.3x faster for generation and ~5.6x faster for prompt processing — see bm-009. The original hardware spec ('24GB NVIDIA reference') was also wrong. This record is retained for editorial history; do not cite its numbers.
RELATED EQUIPMENT GUIDES
If these numbers point you toward hardware, these buyer-intent guides go deeper. Links below are editorial; they carry no affiliate tag.
-
The measured GPU buyer's guide
Turn this result into a hardware decision.
-
How much VRAM you actually need
Will your target model fit?
-
Build a rig around these numbers
A complete sub-$1,000 local-AI lab.