Mathematical Reasoning on GSM8K, MATH, SVAMP, SimulEq, AQuA, SAT, MMLU
70.6Accuracy (Aggregate)DEL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DELBase=Qwen2.5-7B, Zero-shot=true2026.05 | 70.6 | 81.7 | 56 | 87.6 | 57 | 65.4 | 78.6 | 67.9 | |
| DIST2LossBase=Qwen2.5-7B, Zero-shot=true2026.05 | 69.2 | 81.7 | 56 | 87 | 51.8 | 63.8 | 76.8 | 67.6 | |
| NTL-WASBase=Qwen2.5-7B, Zero-shot=true2026.05 | 68.8 | 81.5 | 54.6 | 87.1 | 53.5 | 59.8 | 79.1 | 65.9 | |
| EMOBase=Qwen2.5-7B, Zero-shot=true2026.05 | 68.5 | 81.4 | 55.8 | 87.6 | 50.2 | 63 | 75 | 66.2 | |
| MLEBase=Qwen2.5-7B, Zero-shot=true2026.05 | 68.3 | 81.4 | 51.6 | 87 | 51 | 63.8 | 76.8 | 66.3 | |
| MixCEBase=Qwen2.5-7B, Zero-shot=true2026.05 | 68.3 | 81.6 | 55.3 | 86.9 | 53.5 | 61.4 | 72.7 | 66.5 | |
| DELBase=DeepSeek-math-7B-Ins., Zero-shot=true2026.05 | 66.1 | 77.6 | 51.9 | 83 | 52.5 | 61 | 74.5 | 62.1 | |
| NTL-WASBase=DeepSeek-math-7B-Ins., Zero-shot=true2026.05 | 64.9 | 77 | 51.7 | 81.6 | 50.2 | 59.4 | 73.6 | 60.8 | |
| EMOBase=DeepSeek-math-7B-Ins., Zero-shot=true2026.05 | 64.8 | 77.6 | 50.9 | 80.7 | 54.7 | 57.9 | 69.5 | 62.1 | |
| DIST2LossBase=DeepSeek-math-7B-Ins., Zero-shot=true2026.05 | 64.8 | 76.6 | 51.2 | 82.5 | 53.7 | 58.3 | 69.5 | 61.7 | |
| MixCEBase=DeepSeek-math-7B-Ins., Zero-shot=true2026.05 | 64.6 | 77.2 | 51.2 | 81.2 | 54.9 | 55.9 | 70.1 | 61.9 | |
| MLEBase=DeepSeek-math-7B-Ins., Zero-shot=true2026.05 | 64.4 | 76.8 | 51.4 | 80.9 | 52.7 | 59.1 | 69.1 | 60.9 | |
| DART-Math-7B (Prop2Diff)Base=DeepSeek-math, Zero-shot=true2026.05 | 63.1 | 87.4 | 52.6 | 83.8 | 73.7 | 38.6 | 56.8 | 48.5 | |
| MathScale-7BBase=Mistral, Zero-shot=true2026.05 | 61 | 75.6 | 37.8 | 80.6 | 75.7 | 44.5 | 62.3 | 50.6 | |
| DELBase=Mistral-7B, Zero-shot=true2026.05 | 56.5 | 76 | 40.3 | 81.7 | 46.9 | 53.1 | 51.8 | 45.5 | |
| NTL-WASBase=Mistral-7B, Zero-shot=true2026.05 | 55.6 | 75.1 | 39.9 | 83.5 | 44.9 | 49.2 | 49.5 | 46.8 | |
| DELBase=Qwen2.5-1.5B, Zero-shot=true2026.05 | 55.4 | 57 | 42.6 | 74 | 48.1 | 48.8 | 60.9 | 56.1 | |
| Skywork-OR1-Math-7BBase=Qwen2.5-Math, Zero-shot=true2026.05 | 55.1 | 58.5 | 80.3 | 49.6 | 84.3 | 50 | 35 | 55 | |
| MixCEBase=Mistral-7B, Zero-shot=true2026.05 | 55.1 | 75.6 | 39.4 | 81.9 | 45.9 | 49.4 | 47.1 | 46.6 | |
| DIST2LossBase=Mistral-7B, Zero-shot=true2026.05 | 54.6 | 74.8 | 40 | 81.4 | 43.6 | 50.8 | 47.7 | 43.7 | |
| MLEBase=Mistral-7B, Zero-shot=true2026.05 | 54.2 | 75.1 | 39.3 | 82.4 | 44.2 | 48.8 | 45 | 44.9 | |
| NTL-WASBase=Qwen2.5-1.5B, Zero-shot=true2026.05 | 53.8 | 55.1 | 43.5 | 73.3 | 46.1 | 43.1 | 59.1 | 56.3 | |
| EMOBase=Qwen2.5-1.5B, Zero-shot=true2026.05 | 53.4 | 54.5 | 42.6 | 73.5 | 47.7 | 48 | 52.7 | 55.1 | |
| DIST2LossBase=Qwen2.5-1.5B, Zero-shot=true2026.05 | 53.1 | 54.2 | 41.9 | 73.2 | 44.6 | 45.7 | 55.9 | 56.5 | |
| MixCEBase=Qwen2.5-1.5B, Zero-shot=true2026.05 | 52.9 | 52.8 | 42.7 | 72.7 | 43.2 | 47.2 | 54.5 | 57.3 | |
| MLEBase=Qwen2.5-1.5B, Zero-shot=true2026.05 | 52.8 | 54 | 42.3 | 71.6 | 44.2 | 45.3 | 56.4 | 55.5 | |
| DELBase=CodeLlama-7B, Zero-shot=true2026.05 | 49 | 59.9 | 35.7 | 72.4 | 44.4 | 46.9 | 43.6 | 40.1 | |
| WizardMath-V1.1-7BBase=Mistral, Zero-shot=true2026.05 | 48.1 | 74.5 | 29.3 | 75.4 | 70.7 | 25.3 | 33.7 | 28 | |
| DIST2LossBase=CodeLlama-7B, Zero-shot=true2026.05 | 47.6 | 59.4 | 34 | 71.2 | 44.9 | 44.5 | 39.6 | 39.9 | |
| NTL-WASBase=CodeLlama-7B, Zero-shot=true2026.05 | 47.4 | 59.7 | 35 | 72.3 | 44.4 | 39 | 42.7 | 38.5 | |
| MixCEBase=CodeLlama-7B, Zero-shot=true2026.05 | 46.1 | 59.9 | 34.4 | 72.6 | 43 | 38.2 | 34.5 | 40.3 | |
| Xwin-Math-V1.1-7BBase=Llama 2, Zero-shot=true2026.05 | 45.5 | 74.7 | 32.3 | 81 | 50.6 | 26.4 | 27.4 | 26 | |
| Math-Shepherd-RL-7BBase=Mistral, Zero-shot=true2026.05 | 45.4 | 82.6 | 22.6 | 82.4 | 45.3 | 24.4 | 33.2 | 27.1 | |
| MLEBase=CodeLlama-7B, Zero-shot=true2026.05 | 45.2 | 59.4 | 34 | 72 | 40.7 | 37.8 | 34.1 | 38.6 | |
| DeepMath-Zero-Math-7BBase=Qwen2.5-Math, Zero-shot=true2026.05 | 44.6 | 43.7 | 50.8 | 38.7 | 27.2 | 44.9 | 53.6 | 53.5 | |
| MetaMath-7BBase=Mistral, Zero-shot=true2026.05 | 42.2 | 72.5 | 29.4 | 77.5 | 34.2 | 24.8 | 33.2 | 23.7 | |
| CodeLlama-7BBase=Llama-2, Zero-shot=true2026.05 | 24.3 | 25.2 | 13 | 49.4 | 3.5 | 24 | 28.6 | 26.9 | |
| Llama-2-7BZero-shot=true2026.05 | 20.5 | 14.6 | 2.5 | 34.5 | 5 | 30.3 | 26.8 | 29.8 | |
| Vicuna-1.5-7BBase=Llama-2, Zero-shot=true2026.05 | 20.2 | 13.1 | 4.9 | 36.6 | 4.9 | 27.2 | 25.9 | 30.4 | |
| Galactica-6.7BBase=GAL, Zero-shot=true2026.05 | 16.2 | 10.2 | 2.2 | 25.6 | 4.2 | 25.6 | 17.5 | 28 |