Mathematics on AIME 2024 (Accuracy, Throughput)
80AccuracyReasonCache
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ReasonCacheModel=Phi 4 reasoning plus2025.07 | 80 | 245.21 | |
| DenseModel=Phi 4 reasoning plus2025.07 | 80 | 172.77 | |
| DenseModel=QwQ 32B2025.07 | 76.6 | 47.85 | |
| DenseModel=DeepSeek R1 Distill Qwen 32B2025.07 | 73.3 | 71.59 | |
| ReasonCacheModel=QwQ 32B2025.07 | 73.3 | 85.3 | |
| ReasonCacheModel=DeepSeek R1 Distill Qwen 32B2025.07 | 70 | 123.4 | |
| RandomModel=DeepSeek R1 Distill Qwen 32B2025.07 | 36.7 | 120.8 | |
| RandomModel=Phi 4 reasoning plus2025.07 | 33.3 | 243.2 | |
| RandomModel=QwQ 32B2025.07 | 30 | 85.7 |