Natural Language Inference on ANLI R3
67.1AccuracyPaLM 2-L
Evaluation Results
| Method | Links | |
|---|---|---|
| PaLM 2-Lprompting=1-shot2023.05 | 67.1 | |
| Self-consistencyPrompting strategy=Self-consistency, Backbone model=PaLM-540B2022.03 | 63.4 | |
| CoT-promptingPrompting strategy=Chain-of-Thought, Backbone model=PaLM-540B2022.03 | 60.6 | |
| Standard-prompting (no-rationale)Prompting strategy=no-rationale, Backbone model=PaLM-540B2022.03 | 55.8 | |
| PaLM 2-Mprompting=1-shot2023.05 | 54.5 | |
| PaLM 2-Sprompting=1-shot2023.05 | 53.2 | |
| PaLMprompting=1-shot2023.05 | 52.3 |