Symbolic Reasoning on Colored Object
95.1Solve RatePAL Codex
Evaluation Results
| Method | Links | |
|---|---|---|
| PAL CodexPrompting Strategy=Program-aided Language Models, Backbone Model=Codex2022.11 | 95.1 | |
| COT CodexPrompting Strategy=Chain-of-thought, Backbone Model=Codex2022.11 | 86.3 | |
| DIRECT CodexPrompting Strategy=Direct, Backbone Model=Codex2022.11 | 75.7 |