List your company
ResearchFormerly WizWand

Decode on AMD Ryzen AI 9 HX 370 CPU

225Tokens/s (1K Context)Granite-4.0-350M
23.2475.62128180.38Nov 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Granite-4.0-350MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11225166.2
LFM2-350MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11207.7170.5
Granite-4.0-H-350MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11134.7123.2
LFM2-700MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11134.6118.4
Qwen3-0.6BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1111653.4
Gemma-3-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11103.699.3
LFM2-1.2BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1199.789
Llama-3.2-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1197.373.5
LFM2-8B-A1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1174.969.1
Granite-4.0-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1164.543.6
Qwen3-1.7BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1160.838.5
Granite-4.0-H-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1159.657.1
Granite-4.0-H-TinyBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.115552.1
LFM2-2.6BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1150.346.8
SmolLM3-3BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1142.433.4
Llama-3.2-3BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1138.328.2
Granite-4.0-MicroBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1136.728.9
Granite-4.0-H-MicroBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.1134.733.8
Gemma-3-4BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.113331.6
Qwen3-4BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.113122.2