List your company
ResearchFormerly WizWand

Mathematical Reasoning on AIME and HMMT Average

45Pass@1 AbsoluteTeacher
6.5216.5126.536.49Jul 6, 2026
Updated 3mo ago

Evaluation results

MethodLinks
TeacherModel=Qwen3 4B, Compression Ratio (CR)=None2026.0745100
KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=75%2026.074498
KVpopModel=Qwen3 4B, Compression Ratio (CR)=75%2026.074498
KVpopModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0744100
KVpopModel=Qwen3 4B, Compression Ratio (CR)=88%2026.074497
TeacherModel=Qwen3 8B, Compression Ratio (CR)=None2026.0743100
DMSModel=Qwen3 4B, Compression Ratio (CR)=75%2026.074396
KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0743100
KVpopModel=Qwen3 8B, Compression Ratio (CR)=88%2026.0743100
KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=88%2026.074293
KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=88%2026.074298
StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=75%2026.074192
DMSModel=Qwen3 8B, Compression Ratio (CR)=75%2026.074195
DMSModel=Qwen3 4B, Compression Ratio (CR)=88%2026.074089
StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=75%2026.073991
DMSModel=Qwen3 8B, Compression Ratio (CR)=88%2026.073684
StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=75%2026.073476
TOVAModel=Qwen3 4B, Compression Ratio (CR)=75%2026.073373
StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=88%2026.073374
StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=88%2026.072967
TOVAModel=Qwen3 8B, Compression Ratio (CR)=75%2026.072660
TOVAModel=Qwen3 4B, Compression Ratio (CR)=88%2026.072658
StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=88%2026.072147
StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07819
StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07819
TOVAModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07819