Mathematical Reasoning on GSM8K Depth +2 (test)
62.5AccuracyCLAUDE-3-OPUS
Evaluation results
| Method | Links | |
|---|---|---|
| CLAUDE-3-OPUSPrompting=CoT, Framework=DARG2024.06 | 62.5 | |
| GPT-4-OPrompting=CoT, Framework=DARG2024.06 | 62 | |
| GPT-4-TURBOPrompting=CoT, Framework=DARG2024.06 | 60.5 | |
| GEMINI-1.5-PROPrompting=CoT, Framework=DARG2024.06 | 57.5 | |
| GEMINI-1.5-FLASHPrompting=CoT, Framework=DARG2024.06 | 57 | |
| LLAMA-3-70BPrompting=CoT, Framework=DARG2024.06 | 54 | |
| MIXTRAL 8x22BPrompting=CoT, Framework=DARG2024.06 | 53.5 | |
| WIZARDLM-2 8x22BPrompting=CoT, Framework=DARG2024.06 | 53.5 | |
| GPT-3.5-TURBOPrompting=CoT, Framework=DARG2024.06 | 49 | |
| COMMAND R+104BPrompting=CoT, Framework=DARG2024.06 | 48.5 | |
| PHI-3-MINI-3.8BPrompting=CoT, Framework=DARG2024.06 | 47.5 | |
| DEEPSEEKMATH-7BPrompting=CoT, Framework=DARG2024.06 | 46 | |
| LLAMA-3-8BPrompting=CoT, Framework=DARG2024.06 | 39.5 | |
| MIXTRAL 8x7BPrompting=CoT, Framework=DARG2024.06 | 35.5 | |
| MISTRAL-7BPrompting=CoT, Framework=DARG2024.06 | 18.5 |