Closed-Book Question Answering on BoolQ
78.4AccuracySelf-consistency
Evaluation results
| Method | Links | |
|---|---|---|
| Self-consistencyPrompting strategy=Self-consistency, Backbone model=PaLM-540B2022.03 | 78.4 | |
| CoT-promptingPrompting strategy=Chain-of-Thought, Backbone model=PaLM-540B2022.03 | 74.2 | |
| Standard-prompting (no-rationale)Prompting strategy=no-rationale, Backbone model=PaLM-540B2022.03 | 71.3 |