List your company
ResearchFormerly WizWand

LLM Decode Throughput on Apple M3 base tg128 (test)

223Throughput (tok/s)BaseRT
13.12867.614122.1176.586Jul 1, 2026
Updated 4mo ago

Evaluation results

MethodLinks
BaseRTModel=Qwen3 0.6B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.072231.241.22
MLXModel=Qwen3 0.6B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.07182.3——
llama.cppModel=Qwen3 0.6B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.07180.5——
BaseRTModel=Llama 3.2 1B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.07125.61.181.12
BaseRTModel=Qwen3 0.6B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.07124.61.251.1
MLXModel=Qwen3 0.6B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.07113.6——
MLXModel=Llama 3.2 1B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.07112.6——
llama.cppModel=Llama 3.2 1B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.07106.3——
llama.cppModel=Qwen3 0.6B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0799.8——
BaseRTModel=Llama 3.2 1B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0765.11.131.04
MLXModel=Llama 3.2 1B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0762.4——
BaseRTModel=Gemma 4 E2B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.07591.25—
llama.cppModel=Llama 3.2 1B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0757.5——
llama.cppModel=Gemma 4 E2B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.0747.1——
BaseRTModel=Llama 3.2 3B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.0744.51.141.01
MLXModel=Llama 3.2 3B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.0743.9——
llama.cppModel=Llama 3.2 3B, Quant=Q4, Hardware=Apple M3 base, Target Generation Length=tg1282026.0739——
BaseRTModel=Gemma 4 E2B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0735.41.34—
llama.cppModel=Gemma 4 E2B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0726.5——
BaseRTModel=Llama 3.2 3B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0724.21.141.09
MLXModel=Llama 3.2 3B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0722.2——
llama.cppModel=Llama 3.2 3B, Quant=Q8, Hardware=Apple M3 base, Target Generation Length=tg1282026.0721.2——