List your company
ResearchFormerly WizWand

Mathematical Reasoning on HMMT 2511 (Pass@1)

43Pass@1Teacher
3.4813.742434.26Jul 6, 2026
Updated 3mo ago

Evaluation results

MethodLinks
TeacherModel=Qwen3 4B, Compression Ratio (CR)=None2026.0743
KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0740
KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=88%2026.0740
KVpopModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0739
KVpopModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0739
KVpopModel=Qwen3 8B, Compression Ratio (CR)=88%2026.0739
DMSModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0738
KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0738
KVpopModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0738
KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0738
TeacherModel=Qwen3 8B, Compression Ratio (CR)=None2026.0737
StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=75%2026.0736
StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=75%2026.0735
DMSModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0735
DMSModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0735
StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0733
DMSModel=Qwen3 8B, Compression Ratio (CR)=88%2026.0731
StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=88%2026.0729
TOVAModel=Qwen3 8B, Compression Ratio (CR)=75%2026.0728
TOVAModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0728
StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=88%2026.0724
StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=88%2026.0717
TOVAModel=Qwen3 4B, Compression Ratio (CR)=75%2026.0710
TOVAModel=Qwen3 8B, Compression Ratio (CR)=88%2026.078
StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=75%2026.075
StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=88%2026.075