Closed-Book QA on ARC Easy
80.9AccuracyLaMDA-PT 137B
Evaluation Results
| Method | Links | |
|---|---|---|
| LaMDA-PT 137BEvaluation protocol=few-shot, k=variable2022.12 | 80.9 | |
| FLAN 137BEvaluation protocol=few-shot, k=variable, Training strategy=leave-one-category-out2022.12 | 80.5 | |
| OPT-IML 175BEvaluation protocol=0-shot2022.12 | 80.5 | |
| FLAN 137BEvaluation protocol=0-shot, Training strategy=leave-one-category-out2022.12 | 79.5 | |
| OPT-IML 175BEvaluation protocol=few-shot, k=52022.12 | 76.9 | |
| LaMDA-PT 137BEvaluation protocol=0-shot2022.12 | 76.4 | |
| OPT-IML 30BEvaluation protocol=0-shot2022.12 | 72.5 | |
| OPT-IML 30BEvaluation protocol=few-shot, k=52022.12 | 69.1 | |
| OPT 175BEvaluation protocol=few-shot, k=52022.12 | 52.4 | |
| OPT 175BEvaluation protocol=0-shot2022.12 | 39.4 | |
| OPT 30BEvaluation protocol=few-shot, k=52022.12 | 38.8 | |
| OPT 30BEvaluation protocol=0-shot2022.12 | 34.2 |