Reasoning on CR
54.53AccuracySelf-rethinking
Evaluation results
| Method | Links | |
|---|---|---|
| Self-rethinkingModel=PaLM2, Prompting Strategy=Self-rethinking, k=12024.03 | 54.53 | |
| CoTModel=PaLM2, Prompting Strategy=Chain-of-Thought2024.03 | 51.98 | |
| Standard PromptingModel=PaLM2, Prompting Strategy=Standard Prompting2024.03 | 24.45 | |
| Self-consistencyModel=PaLM2, Prompting Strategy=Self-consistency, inference times=32024.03 | 22.58 | |
| Self-refineModel=PaLM2, Prompting Strategy=Self-refine2024.03 | 12.28 |