Mathematical Reasoning on ASDIV
79.6Solve RatePAL
Evaluation results
| Method | Links | |
|---|---|---|
| PALPrompting Strategy=Program-aided, Model=Codex2022.11 | 79.6 | |
| COT CodexPrompting Strategy=Chain-of-Thought, Model=Codex2022.11 | 76.9 | |
| DIRECT CodexPrompting Strategy=Direct, Model=Codex2022.11 | 74 | |
| COT PaLM-540BPrompting Strategy=Chain-of-Thought, Model=PaLM-540B2022.11 | 73.9 | |
| COT LAMDA-137BPrompting Strategy=Chain-of-Thought, Model=LaMDA-137B2022.11 | 49 | |
| COT UL2-20BPrompting Strategy=Chain-of-Thought, Model=UL2-20B2022.11 | 16.9 |