Algorithmic Task on Repeat Copy
90.6Solve RatePAL Codex
Evaluation results
| Method | Links | |
|---|---|---|
| PAL CodexPrompting Strategy=Program-aided Language Models, Backbone Model=Codex2022.11 | 90.6 | |
| DIRECT CodexPrompting Strategy=Direct, Backbone Model=Codex2022.11 | 81.3 | |
| COT CodexPrompting Strategy=Chain-of-thought, Backbone Model=Codex2022.11 | 68.8 |