Mathematical Problem Solving on MMLU STEM
63.9AccuracyMinerva
Evaluation results
| Method | Links | |
|---|---|---|
| MinervaSize=540B, Evaluation=Chain-of-thought prompting, Source=Closed-Source Base Model2024.02 | 63.9 | |
| DeepSeekMath-BaseSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 56.5 | |
| MinervaSize=62B, Evaluation=Chain-of-thought prompting, Source=Closed-Source Base Model2024.02 | 53.9 | |
| LlemmaSize=34B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 52.9 | |
| MistralSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 51.1 | |
| LlemmaSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 43.1 | |
| MinervaSize=7B, Evaluation=Chain-of-thought prompting, Source=Closed-Source Base Model2024.02 | 35.6 |