Mathematical Reasoning on ConceptMath Elementary-ZH
72.28AccuracyGPT-4
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4Prompt Setting=ZS-COT, Model Size=Proprietary2024.02 | 72.28 | |
| GPT-4Prompt Setting=FS, Model Size=Proprietary2024.02 | 72 | |
| Qwen-72BPrompt Setting=ZS, Model Size=72B2024.02 | 71.16 | |
| Qwen-72BPrompt Setting=ZS-COT, Model Size=72B2024.02 | 68.65 | |
| GPT-4Prompt Setting=ZS, Model Size=Proprietary2024.02 | 67.91 | |
| Qwen-14BPrompt Setting=ZS-COT, Model Size=14B2024.02 | 65.12 | |
| Qwen-14BPrompt Setting=FS, Model Size=14B2024.02 | 64.47 | |
| DeepSeekMath-7BPrompt Setting=FS, Model Size=7B2024.02 | 64.19 | |
| InternLM2-Math-20BPrompt Setting=ZS, Model Size=20B2024.02 | 62.98 | |
| DeepSeekMath-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 62.33 | |
| InternLM2-Math-20BPrompt Setting=ZS-COT, Model Size=20B2024.02 | 61.95 | |
| Qwen-72BPrompt Setting=FS, Model Size=72B2024.02 | 61.86 | |
| InternLM2-Math-20BPrompt Setting=FS, Model Size=20B2024.02 | 61.77 | |
| DeepSeekMath-7BPrompt Setting=ZS, Model Size=7B2024.02 | 60.47 | |
| InternLM2-20BPrompt Setting=FS, Model Size=20B2024.02 | 59.81 | |
| InternLM2-Math-7BPrompt Setting=FS, Model Size=7B2024.02 | 58.6 | |
| InternLM2-Math-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 58.23 | |
| Baichuan2-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 58.23 | |
| InternLM2-Math-7BPrompt Setting=ZS, Model Size=7B2024.02 | 57.3 | |
| Baichuan2-13BPrompt Setting=ZS, Model Size=13B2024.02 | 57.02 | |
| GPT-3.5Prompt Setting=FS, Model Size=Proprietary2024.02 | 56.93 | |
| GPT-3.5Prompt Setting=ZS, Model Size=Proprietary2024.02 | 56.47 | |
| InternLM2-20BPrompt Setting=ZS-COT, Model Size=20B2024.02 | 55.53 | |
| GPT-3.5Prompt Setting=ZS-COT, Model Size=Proprietary2024.02 | 53.21 | |
| InternLM2-7BPrompt Setting=FS, Model Size=7B2024.02 | 53.02 | |
| Yi-34BPrompt Setting=ZS-COT, Model Size=34B2024.02 | 51.16 | |
| Yi-34BPrompt Setting=ZS, Model Size=34B2024.02 | 50.05 | |
| InternLM2-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 49.02 | |
| InternLM2-20BPrompt Setting=ZS, Model Size=20B2024.02 | 48.19 | |
| InternLM2-7BPrompt Setting=ZS, Model Size=7B2024.02 | 47.63 | |
| ChatGLM3-6BPrompt Setting=ZS, Model Size=6B2024.02 | 46.23 | |
| ChatGLM3-6BPrompt Setting=ZS-COT, Model Size=6B2024.02 | 43.63 | |
| ChatGLM3-6BPrompt Setting=FS, Model Size=6B2024.02 | 40.74 | |
| Yi-34BPrompt Setting=FS, Model Size=34B2024.02 | 38.79 | |
| Yi-6BPrompt Setting=FS, Model Size=6B2024.02 | 37.86 | |
| Yi-6BPrompt Setting=ZS, Model Size=6B2024.02 | 34.33 | |
| MAmmoTH-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 33.3 | |
| Yi-6BPrompt Setting=ZS-COT, Model Size=6B2024.02 | 31.91 | |
| LLaMA2-70BPrompt Setting=ZS, Model Size=70B2024.02 | 28.65 | |
| Qwen-14BPrompt Setting=ZS, Model Size=14B2024.02 | 28.09 | |
| MetaMath-13BPrompt Setting=FS, Model Size=13B2024.02 | 27.53 | |
| LLaMA2-70BPrompt Setting=ZS-COT, Model Size=70B2024.02 | 26.7 | |
| LLaMA2-70BPrompt Setting=FS, Model Size=70B2024.02 | 24.37 | |
| LLaMA2-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 24.19 | |
| MAmmoTH-13BPrompt Setting=FS, Model Size=13B2024.02 | 23.81 | |
| MAmmoTH-13BPrompt Setting=ZS, Model Size=13B2024.02 | 22.33 | |
| LLaMA2-13BPrompt Setting=FS, Model Size=13B2024.02 | 22.14 | |
| Baichuan2-13BPrompt Setting=FS, Model Size=13B2024.02 | 22.05 | |
| LLaMA2-13BPrompt Setting=ZS, Model Size=13B2024.02 | 20.19 | |
| WizardMath-13BPrompt Setting=FS, Model Size=13B2024.02 | 18.7 | |
| LLaMA2-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 17.67 | |
| LLaMA2-7BPrompt Setting=FS, Model Size=7B2024.02 | 17.58 | |
| MetaMath-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 17.3 | |
| LLaMA2-7BPrompt Setting=ZS, Model Size=7B2024.02 | 15.72 | |
| MetaMath-13BPrompt Setting=ZS, Model Size=13B2024.02 | 11.44 | |
| WizardMath-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 11.26 | |
| WizardMath-13BPrompt Setting=ZS, Model Size=13B2024.02 | 10.51 |