Math Reasoning on MATH (test) (Category Scores)
64.5Algebra ScoreStrategyLLM-ZS
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| StrategyLLM-ZSSetting=Zero-shot2023.11 | 64.5 | 65.5 | 19 | 39 | 32.5 | 28.5 | 22.5 | 38.8 | |
| StrategyLLM-SCSetting=Few-shot, Consistency=Self-Consistency2023.11 | 60 | 61.5 | 18 | 38.5 | 30.5 | 28 | 24 | 37.2 | |
| CoT-SCPrompting Strategy=Self-Consistency with CoT, Setting=Few-shot, Reasoning paths=3, Temperature=0.72023.11 | 59 | 62 | 16.5 | 34.5 | 28 | 24.5 | 15 | 34.2 | |
| SolutionLLMSetting=Few-shot2023.11 | 58.5 | 56.5 | 13.5 | 33 | 32 | 28 | 19.5 | 34.4 | |
| StrategyLLMSetting=Few-shot2023.11 | 58.5 | 57.5 | 18 | 35 | 29.5 | 24.5 | 22.5 | 35.1 | |
| CoTPrompting Strategy=Chain-of-Thought, Setting=Few-shot2023.11 | 57 | 57.5 | 15 | 33.5 | 28 | 23 | 20 | 33.4 | |
| SPPrompting Strategy=Standard Prompting, Setting=Few-shot2023.11 | 32 | 50 | 17.5 | 27 | 20.5 | 21 | 20.5 | 26.9 |