Open-domain QA on NQ
37.6QA-F1UnifiedQA-3b
Evaluation Results
| Method | Links | |
|---|---|---|
| UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.07 | 37.6 | |
| UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.07 | 36.3 | |
| UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.07 | 34.6 | |
| GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.07 | 10.9 | |
| GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 6.9 | |
| T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 6.6 | |
| T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 6 | |
| OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.07 | 5.3 | |
| UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.07 | 4.4 | |
| UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.07 | 3.8 | |
| UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.07 | 3 | |
| T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 2.7 | |
| OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.07 | 2.1 | |
| T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.07 | 1.9 | |
| T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.07 | 1.7 | |
| T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.07 | 1.6 |