Mathematical Reasoning on AIME and HMMT Average
45Pass@1 AbsoluteTeacher
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TeacherModel=Qwen3 4B, Compression Ratio (CR)=None2026.07 | 45 | 100 | |
| KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 44 | 98 | |
| KVpopModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 44 | 98 | |
| KVpopModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 44 | 100 | |
| KVpopModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 44 | 97 | |
| TeacherModel=Qwen3 8B, Compression Ratio (CR)=None2026.07 | 43 | 100 | |
| DMSModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 43 | 96 | |
| KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 43 | 100 | |
| KVpopModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 43 | 100 | |
| KVpopmlpModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 42 | 93 | |
| KVpopmlpModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 42 | 98 | |
| StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 41 | 92 | |
| DMSModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 41 | 95 | |
| DMSModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 40 | 89 | |
| StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 39 | 91 | |
| DMSModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 36 | 84 | |
| StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 34 | 76 | |
| TOVAModel=Qwen3 4B, Compression Ratio (CR)=75%2026.07 | 33 | 73 | |
| StreamLLM+Model=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 33 | 74 | |
| StreamLLM+Model=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 29 | 67 | |
| TOVAModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 26 | 60 | |
| TOVAModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 26 | 58 | |
| StreamLLMModel=Qwen3 4B, Compression Ratio (CR)=88%2026.07 | 21 | 47 | |
| StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=75%2026.07 | 8 | 19 | |
| StreamLLMModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 8 | 19 | |
| TOVAModel=Qwen3 8B, Compression Ratio (CR)=88%2026.07 | 8 | 19 |