Mathematical Reasoning on DeepMind-Mathematics (test)
64.1AccuracyDART-Math-Llama3-70B (Uniform)
Evaluation results
| Method | Links | |
|---|---|---|
| DART-Math-Llama3-70B (Uniform)number of samples=0.59M, Base Model=Llama3-70B, Sampling Strategy=Uniform2024.06 | 64.1 | |
| DART-Math-Llama3-70B (Prop2Diff)number of samples=0.59M, Base Model=Llama3-70B, Sampling Strategy=Prop2Diff2024.06 | 64.1 | |
| Llama3-70B-VRTnumber of samples=0.59M, Base Model=Llama3-70B2024.06 | 62.8 | |
| DART-Math-DSMath-7B (Prop2Diff)number of samples=0.59M, Base Model=DeepSeekMath-7B, Sampling Strategy=Prop2Diff2024.06 | 61.6 | |
| Llama3-70B-MMIQCnumber of samples=2.3M, Base Model=Llama3-70B2024.06 | 60.4 | |
| DeepSeekMath-7B-VRTnumber of samples=0.59M, Base Model=DeepSeekMath-7B2024.06 | 60.2 | |
| DART-Math-DSMath-7B (Uniform)number of samples=0.59M, Base Model=DeepSeekMath-7B, Sampling Strategy=Uniform2024.06 | 60.2 | |
| Llama2-70B-Xwin-Math-V1.1+number of samples=1.4M, Base Model=Llama2-70B2024.06 | 58 | |
| Llama3-70B-MetaMathnumber of samples=0.40M, Base Model=Llama3-70B2024.06 | 53.2 | |
| DeepSeekMath-7B-MMIQCnumber of samples=2.3M, Base Model=DeepSeekMath-7B2024.06 | 52.9 | |
| DeepSeekMath-7B-Instructnumber of samples=0.78M, Base Model=DeepSeekMath-7B2024.06 | 52.2 | |
| Llama3-70B-ICLBase Model=Llama3-70B2024.06 | 51.7 | |
| DART-Math-Llama3-8B (Uniform)number of samples=0.59M, Base Model=Llama3-8B, Sampling Strategy=Uniform2024.06 | 48.2 | |
| DART-Math-Llama3-8B (Prop2Diff)number of samples=0.59M, Base Model=Llama3-8B, Sampling Strategy=Prop2Diff2024.06 | 48 | |
| DeepSeekMath-7B-ICLBase Model=DeepSeekMath-7B2024.06 | 45.2 | |
| DART-Math-Mistral-7B (Prop2Diff)number of samples=0.59M, Base Model=Mistral-7B, Sampling Strategy=Prop2Diff2024.06 | 45.1 | |
| Llama2-7B-Xwin-Math-V1.1+number of samples=1.4M, Base Model=Llama2-7B2024.06 | 43 | |
| DART-Math-Mistral-7B (Uniform)number of samples=0.59M, Base Model=Mistral-7B, Sampling Strategy=Uniform2024.06 | 42 | |
| Llama3-8B-VRTnumber of samples=0.59M, Base Model=Llama3-8B2024.06 | 41.7 | |
| Llama3-8B-MMIQCnumber of samples=2.3M, Base Model=Llama3-8B2024.06 | 41 | |
| Mistral-7B-WizardMath-V1.1 (RL)Base Model=Mistral-7B2024.06 | 38.4 | |
| Mistral-7B-MMIQCnumber of samples=2.3M, Base Model=Mistral-7B2024.06 | 38 | |
| Mistral-7B-VRTnumber of samples=0.59M, Base Model=Mistral-7B2024.06 | 35.6 | |
| Llama3-8B-MetaMathnumber of samples=0.40M, Base Model=Llama3-8B2024.06 | 35 | |
| Mistral-7B-MetaMathnumber of samples=0.40M, Base Model=Mistral-7B2024.06 | 28 | |
| Llama3-8B-ICLBase Model=Llama3-8B2024.06 | 27.4 | |
| Mistral-7B-ICLBase Model=Mistral-7B2024.06 | 23.5 |