Mathematical Reasoning on ConceptMath Middle-ZH
71.3AccuracyQwen-72B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-72BPrompt Setting=ZS, Model Size=72B2024.02 | 71.3 | |
| GPT-4Prompt Setting=FS, Model Size=Proprietary2024.02 | 66.61 | |
| Qwen-72BPrompt Setting=ZS-COT, Model Size=72B2024.02 | 65.43 | |
| GPT-4Prompt Setting=ZS-COT, Model Size=Proprietary2024.02 | 64.26 | |
| GPT-4Prompt Setting=ZS, Model Size=Proprietary2024.02 | 63.81 | |
| Qwen-72BPrompt Setting=FS, Model Size=72B2024.02 | 62.45 | |
| Qwen-14BPrompt Setting=FS, Model Size=14B2024.02 | 62.09 | |
| Qwen-14BPrompt Setting=ZS-COT, Model Size=14B2024.02 | 58.3 | |
| DeepSeekMath-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 56.95 | |
| DeepSeekMath-7BPrompt Setting=FS, Model Size=7B2024.02 | 56.86 | |
| InternLM2-Math-20BPrompt Setting=FS, Model Size=20B2024.02 | 56.86 | |
| InternLM2-20BPrompt Setting=FS, Model Size=20B2024.02 | 56.68 | |
| DeepSeekMath-7BPrompt Setting=ZS, Model Size=7B2024.02 | 56.5 | |
| InternLM2-Math-20BPrompt Setting=ZS-COT, Model Size=20B2024.02 | 55.78 | |
| GPT-3.5Prompt Setting=FS, Model Size=Proprietary2024.02 | 55.69 | |
| Baichuan2-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 55.32 | |
| InternLM2-Math-20BPrompt Setting=ZS, Model Size=20B2024.02 | 55.14 | |
| Baichuan2-13BPrompt Setting=ZS, Model Size=13B2024.02 | 55.05 | |
| InternLM2-Math-7BPrompt Setting=FS, Model Size=7B2024.02 | 53.88 | |
| InternLM2-Math-7BPrompt Setting=ZS, Model Size=7B2024.02 | 53.79 | |
| GPT-3.5Prompt Setting=ZS-COT, Model Size=Proprietary2024.02 | 53.52 | |
| InternLM2-Math-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 53.16 | |
| GPT-3.5Prompt Setting=ZS, Model Size=Proprietary2024.02 | 51.9 | |
| InternLM2-20BPrompt Setting=ZS-COT, Model Size=20B2024.02 | 50.63 | |
| InternLM2-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 45.4 | |
| Yi-34BPrompt Setting=ZS, Model Size=34B2024.02 | 45.4 | |
| InternLM2-7BPrompt Setting=ZS, Model Size=7B2024.02 | 45.22 | |
| InternLM2-20BPrompt Setting=ZS, Model Size=20B2024.02 | 45.13 | |
| InternLM2-7BPrompt Setting=FS, Model Size=7B2024.02 | 44.86 | |
| ChatGLM3-6BPrompt Setting=ZS, Model Size=6B2024.02 | 44.77 | |
| Yi-34BPrompt Setting=ZS-COT, Model Size=34B2024.02 | 43.95 | |
| ChatGLM3-6BPrompt Setting=ZS-COT, Model Size=6B2024.02 | 43.32 | |
| MAmmoTH-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 43.05 | |
| Yi-34BPrompt Setting=FS, Model Size=34B2024.02 | 40.97 | |
| ChatGLM3-6BPrompt Setting=FS, Model Size=6B2024.02 | 40.43 | |
| LLaMA2-70BPrompt Setting=ZS, Model Size=70B2024.02 | 37.64 | |
| Yi-6BPrompt Setting=ZS, Model Size=6B2024.02 | 36.46 | |
| Yi-6BPrompt Setting=FS, Model Size=6B2024.02 | 36.46 | |
| Yi-6BPrompt Setting=ZS-COT, Model Size=6B2024.02 | 36.19 | |
| LLaMA2-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 35.38 | |
| LLaMA2-70BPrompt Setting=ZS-COT, Model Size=70B2024.02 | 34.3 | |
| LLaMA2-13BPrompt Setting=ZS, Model Size=13B2024.02 | 33.3 | |
| LLaMA2-7BPrompt Setting=ZS-COT, Model Size=7B2024.02 | 32.22 | |
| LLaMA2-7BPrompt Setting=ZS, Model Size=7B2024.02 | 30.87 | |
| MetaMath-13BPrompt Setting=FS, Model Size=13B2024.02 | 29.6 | |
| MAmmoTH-13BPrompt Setting=FS, Model Size=13B2024.02 | 29.15 | |
| LLaMA2-70BPrompt Setting=FS, Model Size=70B2024.02 | 28.43 | |
| MAmmoTH-13BPrompt Setting=ZS, Model Size=13B2024.02 | 27.98 | |
| LLaMA2-7BPrompt Setting=FS, Model Size=7B2024.02 | 27.8 | |
| Baichuan2-13BPrompt Setting=FS, Model Size=13B2024.02 | 26.9 | |
| LLaMA2-13BPrompt Setting=FS, Model Size=13B2024.02 | 26.17 | |
| MetaMath-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 26.08 | |
| WizardMath-13BPrompt Setting=FS, Model Size=13B2024.02 | 22.92 | |
| Qwen-14BPrompt Setting=ZS, Model Size=14B2024.02 | 22.92 | |
| MetaMath-13BPrompt Setting=ZS, Model Size=13B2024.02 | 21.21 | |
| WizardMath-13BPrompt Setting=ZS-COT, Model Size=13B2024.02 | 15.52 | |
| WizardMath-13BPrompt Setting=ZS, Model Size=13B2024.02 | 12.36 |