Few-shot Natural Language Processing on MetaICL (test)
46.1Classification ScoreUnpredicTable-5k
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| UnpredicTable-5ktraining_data=UnpredicTable-5k, backbone=GPT2-large, shot_setting=k-shot2022.08 | 46.1 | 43.7 | 42.3 | 36.3 | 45.7 | |
| MetaICL k-shottraining_data=NLP (IID)2022.08 | 43.4 | — | 45.9 | — | — | |
| MetaICL k-shottraining_data=NLP (OOD)2022.08 | 38.2 | 43.2 | 38.7 | 49 | 33.1 | |
| GPT2shot_setting=k-shot2022.08 | 37.4 | 38.2 | 40.2 | 34 | 33.7 | |
| GPT2shot_setting=0-shot2022.08 | 34.2 | 34.9 | 40.4 | 25.5 | 34.2 |