Symbolic Reasoning on Penguins
93.3Solve RatePAL Codex
Evaluation Results
| Method | Links | |
|---|---|---|
| PAL CodexPrompting Strategy=Program-aided Language Models, Backbone Model=Codex2022.11 | 93.3 | |
| COT CodexPrompting Strategy=Chain-of-thought, Backbone Model=Codex2022.11 | 79.2 | |
| DIRECT CodexPrompting Strategy=Direct, Backbone Model=Codex2022.11 | 71.1 | |
| COT PaLM-540BPrompting Strategy=Chain-of-thought, Backbone Model=PaLM-540B2022.11 | 65.1 |