Mathematical Problem Solving on OCW
17.6AccuracyMinerva
Evaluation results
| Method | Links | |
|---|---|---|
| MinervaSize=540B, Evaluation=Chain-of-thought prompting, Source=Closed-Source Base Model2024.02 | 17.6 | |
| DeepSeekMath-BaseSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 15.4 | |
| MinervaSize=62B, Evaluation=Chain-of-thought prompting, Source=Closed-Source Base Model2024.02 | 12 | |
| LlemmaSize=34B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 10.3 | |
| MistralSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 9.2 | |
| MinervaSize=7B, Evaluation=Chain-of-thought prompting, Source=Closed-Source Base Model2024.02 | 7.7 | |
| LlemmaSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 6.3 |