Mathematical Problem Solving on Gaokao MathCloze
72.9AccuracyQwen2-Math-72B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2-Math-72Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 72.9 | |
| Qwen2.5-Math-72Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 72.9 | |
| Qwen2.5-Math-7Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 57.6 | |
| Qwen2-72Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 55.9 | |
| Qwen2-Math-7Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 48.3 | |
| Qwen2.5-Math-1.5Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 47.5 | |
| Qwen2-7Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 37.3 | |
| Qwen2-Math-1.5Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 37.3 | |
| DeepSeek-Coder-V2-Lite-Baseshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 25.4 | |
| DeepSeekMath-BaseSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 20.3 | |
| DeepSeekMath-Base-7Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 20.3 | |
| InternLM2-Math-Base-20Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 16.9 | |
| Qwen2-1.5Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 12.7 | |
| LlemmaSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 11.9 | |
| LlemmaSize=34B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 11.9 | |
| Llama-3.1-70Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 11.9 | |
| Llama-3.1-8Bshot=5-shot, prompting=few-shot chain-of-thought2024.09 | 8.5 | |
| MistralSize=7B, Evaluation=Chain-of-thought prompting, Source=Open-Source Base Model2024.02 | 5.1 |