List your company
ResearchFormerly WizWand

Mathematical Reasoning on HMMT 2502

31Pass@1KVpop
1.889.441724.56Jul 6, 2026
Updated 3mo ago

Evaluation results

MethodLinks
KVpopModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0731
KVpopModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0731
KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=88%2026.0731
KVpopModel=Qwen3 8B, Compression Ratio (CR)=88%2026.0731
TeacherModel=Qwen3 4B, Compression Ratio (CR)=None2026.0730
StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=75%2026.0730
KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0730
KVpopModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0730
KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0729
TeacherModel=Qwen3 8B, Compression Ratio (CR)=None2026.0728
TOVAModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0728
DMSModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0728
DMSModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0727
DMSModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0727
KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0727
StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=88%2026.0726
StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=75%2026.0725
StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0724
DMSModel=Qwen3 8B, Compression Ratio (CR)=88%2026.0722
TOVAModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0719
StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=88%2026.0718
TOVAModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0715
StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0715
TOVAModel=Qwen3 8B, Compression Ratio (CR)=88%2026.079
StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=75%2026.073
StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=88%2026.073