Multiple Choice Classification on AGNews
84.5AccuracyUnifiedQA-3b
Evaluation Results
| Method | Links | |
|---|---|---|
| UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.07 | 84.5 | |
| UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.07 | 75.7 | |
| UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.07 | 71 | |
| UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.07 | 67.9 | |
| UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.07 | 46.6 | |
| T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 44.4 | |
| T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 39.1 | |
| UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.07 | 35.7 | |
| T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.07 | 30.2 | |
| T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.07 | 27.9 | |
| GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 26.9 | |
| T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.07 | 25.8 | |
| T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 25.2 | |
| GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.07 | 25.1 | |
| OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.07 | 25 | |
| OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 25 |