#small-model

LFM2.5-8B-A1B (Q4_K_M, 8.47B total / ~1.7B active MoE params, 4.79 GiB) measured on TWO GPUs for a clean MoE-vs-GPU comparison: EvoX2's AMD Radeon RX 7900 XT (gfx1100, ROCm) at 269.01 tok/s gen / 7464.85 tok/s prompt using 6.81GB VRAM, and Jitori's Intel Arc Pro B60 (Battlemage, Vulkan) at 68.79 tok/s gen / 1688.53 tok/s prompt. The RX 7900 XT is ~3.9x faster on this MoE than the Arc B60 - the SAME ratio as on the dense Llama-3.1-8B (see bm-008), confirming the GPU gap is consistent across architectures. Companion to bm-011 (the APU iGPU result on the same machine). Closes the small-model and real-app workload gaps.

Llama-3.1-8B-Instruct (Q4_K_M, 8.03B dense params, 4.58 GiB) measured on TWO GPUs for a clean dense-vs-GPU comparison: Jitori's Intel Arc Pro B60 (Battlemage, Vulkan) at 27.01 tok/s gen / 706.61 tok/s prompt, and EvoX2's AMD Radeon RX 7900 XT (gfx1100, ROCm) at 105.22 tok/s gen / 3210.77 tok/s prompt. The RX 7900 XT is ~3.9x faster on this dense 8B than the Arc B60 - the SAME ratio as on the MoE LFM2.5-8B (see bm-007), confirming the GPU gap is consistent across architectures. Closes the general-work workload and dense-general model-class gaps; the 9th of 10.

LFM2.5-8B-A1B (Q4_K_M, 8.47B params, 4.79 GiB) on the integrated Radeon 8060S GPU of EvoX2's AMD Ryzen AI MAX+ 395 (gfx1151, ~124GB unified memory pool visible to HIP). Generates at 150.16 tok/s and processes prompts at 3661.53 tok/s via ROCm 7.2.2. This is the only unified-memory APU in the fleet - the same machine's discrete RX 7900 XT (bm-007) is ~1.8x faster on this small model, but the APU's point is not raw speed: unified memory removes the VRAM ceiling that bounds every discrete card here. Closes the unified-memory / APU platform gap and answers the 'should I buy Strix Halo / Ryzen AI MAX for local AI?' question with first-party data.