Mathematical Reasoning on HMMT 2511 (Pass@1)
43Pass@1Teacher
Evaluation Results
| Method | Links | |
|---|---|---|
| TeacherModel=Qwen3 4B, Compression Ratio (CR)=None2026.07 | 43 | |
| KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 40 | |
| KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 40 | |
| KVpopModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 39 | |
| KVpopModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 39 | |
| KVpopModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 39 | |
| DMSModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 38 | |
| KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 38 | |
| KVpopModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 38 | |
| KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 38 | |
| TeacherModel=Qwen3 8B, Compression Ratio (CR)=None2026.07 | 37 | |
| StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 36 | |
| StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 35 | |
| DMSModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 35 | |
| DMSModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 35 | |
| StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 33 | |
| DMSModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 31 | |
| StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 29 | |
| TOVAModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 28 | |
| TOVAModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 28 | |
| StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 24 | |
| StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 17 | |
| TOVAModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 10 | |
| TOVAModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 8 | |
| StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 5 | |
| StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 5 |