Mathematical Reasoning on (GSM8K, MATH, MathQA, MathPile) (test)
49.36GSM8K AccuracyOpT-DeUS
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| OpT-DeUSBackbone=Llama-3.1-8B, Shots=5-shot2025.12 | 49.36 | 50.04 | 13.84 | 42.58 | 51.94 | |
| MIDUS-HMLBackbone=Llama-3.1-8B, Shots=5-shot2025.12 | 48.9 | 51.78 | 14.34 | 42.58 | 52.53 | |
| Llama ProBackbone=Llama-3.1-8B, Shots=5-shot2025.12 | 41.93 | 41.77 | 13.1 | 40.87 | 45.89 | |
| BaseBackbone=Llama-3.1-8B, Shots=5-shot2025.12 | 35.33 | 33.36 | 11.42 | 37.99 | 39.37 | |
| MIDUS-HMLBackbone=Llama-3.2-1B, Shots=5-shot2025.12 | 6.6 | 6.6 | 5.62 | 31.39 | 16.73 | |
| OpT-DeUSBackbone=Llama-3.2-1B, Shots=5-shot2025.12 | 6.07 | 6.22 | 5.8 | 30.95 | 16.35 | |
| Llama ProBackbone=Llama-3.2-1B, Shots=5-shot2025.12 | 5.61 | 4.4 | 5.64 | 30.62 | 15.42 | |
| BaseBackbone=Llama-3.2-1B, Shots=5-shot2025.12 | 4.32 | 4.93 | 5.66 | 29.88 | 14.93 |