Math on AIME 2025 (Acc, AMSR)
67.7AccuracyDense
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DenseModel=Phi 4 reasoning plus2025.07 | 67.7 | 0 | |
| ReasonCacheModel=QwQ 32B2025.07 | 63.3 | 23.1 | |
| DenseModel=QwQ 32B2025.07 | 63.3 | 0 | |
| ReasonCacheModel=Phi 4 reasoning plus2025.07 | 63.3 | 17.2 | |
| DenseModel=DeepSeek R1 Distill Qwen 32B2025.07 | 53.3 | 0 | |
| QuestModel=QwQ 32B2025.07 | 53.3 | 23.5 | |
| ReasonCacheModel=DeepSeek R1 Distill Qwen 32B2025.07 | 50 | 23.2 | |
| QuestModel=Phi 4 reasoning plus2025.07 | 43.3 | 17.7 | |
| StreamingLLMModel=QwQ 32B2025.07 | 36.7 | 20.6 | |
| StreamingLLMModel=Phi 4 reasoning plus2025.07 | 36.7 | 17 | |
| StreamingLLMModel=DeepSeek R1 Distill Qwen 32B2025.07 | 33.3 | 20.7 | |
| QuestModel=DeepSeek R1 Distill Qwen 32B2025.07 | 33.3 | 25 | |
| SnapKVModel=QwQ 32B2025.07 | 23.3 | 1.43 | |
| SnapKVModel=DeepSeek R1 Distill Qwen 32B2025.07 | 20 | 1.8 | |
| SnapKVModel=Phi 4 reasoning plus2025.07 | 16.6 | 3 |