Mathematical Reasoning on SINGLEOP
94.6Solve RatePAL
Evaluation results
| Method | Links | |
|---|---|---|
| PALPrompting Strategy=Program-aided, Model=Codex2022.11 | 94.6 | |
| COT PaLM-540BPrompting Strategy=Chain-of-Thought, Model=PaLM-540B2022.11 | 94.1 | |
| DIRECT CodexPrompting Strategy=Direct, Model=Codex2022.11 | 93.1 | |
| COT CodexPrompting Strategy=Chain-of-Thought, Model=Codex2022.11 | 91.9 |