List your company
ResearchFormerly WizWand

Prefill Performance on AMD Ryzen AI 9 HX 370 CPU

7,534Prefill Throughput (1K Context) (tokens/s)LFM2-350M
594.082,395.794,197.55,999.21Nov 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LFM2-350MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.117,5345,540
Granite-4.0-350MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.115,4992,938
Granite-4.0-H-350MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.114,5684,250
LFM2-700MBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.114,2143,311
Gemma-3-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.113,9723,809
Qwen3-0.6BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.113,5942,204
Llama-3.2-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.112,9121,890
LFM2-1.2BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.112,7842,302
Qwen3-1.7BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.112,0191,491
Granite-4.0-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,8231,256
Granite-4.0-H-1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,5651,523
LFM2-2.6BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,3351,171
LFM2-8B-A1BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,3201,185
SmolLM3-3BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,248982
Llama-3.2-3BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,179916
Gemma-3-4BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,1191,054
Granite-4.0-H-TinyBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.111,0501,046
Granite-4.0-H-MicroBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11932896
Granite-4.0-MicroBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11929608
Qwen3-4BBatch size=1, Backend=llama.cpp, Quantization=Q4_0, Hardware=AMD Ryzen AI 9 HX 370 CPU2025.11861628