Mathematical Reasoning on ConceptMath Elementary-EN
92.37AccuracyGPT-3.5
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-3.5Prompt Setting=ZS-COT, Model Size=Proprietary2024.02 | 92.37 | |
| GPT-4Prompt Setting=ZS-COT, Model Size=Proprietary2024.02 | 90.2 | |
| GPT-4Prompt Setting=FS, Model Size=Proprietary2024.02 | 89.57 | |
| GPT-4Prompt Setting=ZS, Model Size=Proprietary2024.02 | 86.77 | |
| GPT-3.5Prompt Setting=ZS, Model Size=Proprietary2024.02 | 85.75 | |
| GPT-3.5Prompt Setting=FS, Model Size=Proprietary2024.02 | 84.35 | |
| DeepSeekMath-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 77.35 | |
| Qwen-72BPrompt Setting=FS, Model Size=72B2024.02 | 77.23 | |
| Qwen-72BPrompt Setting=ZS, Model Size=72B2024.02 | 77.1 | |
| InternLM2-Math-20BPrompt Setting=ZS-COT, Model Size=20B2024.02 | 75.32 | |
| Qwen-72BPrompt Setting=ZS-COT, Model Size=72B2024.02 | 75.06 | |
| Yi-34BPrompt Setting=ZS, Model Size=34B2024.02 | 74.68 | |
| InternLM2-Math-20BPrompt Setting=ZS, Model Size=20B2024.02 | 74.05 | |
| DeepSeekMath-7BPrompt Setting=FS, Model Size=7B2024.02 | 73.92 | |
| Yi-34BPrompt Setting=ZS-COT, Model Size=34B2024.02 | 73.66 | |
| InternLM2-Math-20BPrompt Setting=FS, Model Size=20B2024.02 | 73.41 | |
| InternLM2-20BPrompt Setting=FS, Model Size=20B2024.02 | 73.28 | |
| Qwen-14BPrompt Setting=FS, Model Size=14B2024.02 | 72.65 | |
| InternLM2-20BPrompt Setting=ZS-COT, Model Size=20B2024.02 | 72.52 | |
| InternLM2-Math-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 72.01 | |
| InternLM2-Math-7BPrompt Setting=ZS, Model Size=7B2024.02 | 71.12 | |
| InternLM2-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 69.97 | |
| InternLM2-Math-7BPrompt Setting=FS, Model Size=7B2024.02 | 69.59 | |
| InternLM2-7BPrompt Setting=ZS, Model Size=7B2024.02 | 68.83 | |
| Baichuan2-13BPrompt Setting=ZS, Model Size=13B2024.02 | 68.83 | |
| Baichuan2-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 68.58 | |
| Yi-6BPrompt Setting=ZS, Model Size=6B2024.02 | 67.94 | |
| Yi-6BPrompt Setting=ZS-COT, Model Size=6B2024.02 | 67.56 | |
| DeepSeekMath-7BPrompt Setting=ZS, Model Size=7B2024.02 | 66.92 | |
| InternLM2-7BPrompt Setting=FS, Model Size=7B2024.02 | 66.67 | |
| Qwen-14BPrompt Setting=ZS-COT, Model Size=14B2024.02 | 65.78 | |
| ChatGLM3-6BPrompt Setting=ZS-COT, Model Size=6B2024.02 | 63.1 | |
| MAmmoTH-13BPrompt Setting=ZS, Model Size=13B2024.02 | 61.32 | |
| ChatGLM3-6BPrompt Setting=ZS, Model Size=6B2024.02 | 60.69 | |
| LLaMA2-70BPrompt Setting=ZS-COT, Model Size=70B2024.02 | 60.31 | |
| Yi-6BPrompt Setting=FS, Model Size=6B2024.02 | 59.03 | |
| MAmmoTH-13BPrompt Setting=FS, Model Size=13B2024.02 | 56.49 | |
| Yi-34BPrompt Setting=FS, Model Size=34B2024.02 | 56.36 | |
| LLaMA2-70BPrompt Setting=ZS, Model Size=70B2024.02 | 56.11 | |
| MetaMath-13BPrompt Setting=ZS, Model Size=13B2024.02 | 54.45 | |
| Baichuan2-13BPrompt Setting=FS, Model Size=13B2024.02 | 54.07 | |
| InternLM2-20BPrompt Setting=ZS, Model Size=20B2024.02 | 53.31 | |
| ChatGLM3-6BPrompt Setting=FS, Model Size=6B2024.02 | 53.18 | |
| MAmmoTH-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 52.42 | |
| MetaMath-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 51.78 | |
| LLaMA2-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 49.75 | |
| MetaMath-13BPrompt Setting=FS, Model Size=13B2024.02 | 47.96 | |
| LLaMA2-13BPrompt Setting=FS, Model Size=13B2024.02 | 47.07 | |
| Qwen-14BPrompt Setting=ZS, Model Size=14B2024.02 | 46.95 | |
| WizardMath-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 44.78 | |
| LLaMA2-13BPrompt Setting=ZS, Model Size=13B2024.02 | 44.02 | |
| LLaMA2-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 42.62 | |
| WizardMath-13BPrompt Setting=ZS, Model Size=13B2024.02 | 41.73 | |
| LLaMA2-7BPrompt Setting=FS, Model Size=7B2024.02 | 38.68 | |
| LLaMA2-7BPrompt Setting=ZS, Model Size=7B2024.02 | 36.51 | |
| WizardMath-13BPrompt Setting=FS, Model Size=13B2024.02 | 34.99 | |
| LLaMA2-70BPrompt Setting=FS, Model Size=70B2024.02 | 30.53 |