List your company

Open-domain QA on NQ

37.6QA-F1UnifiedQA-3b
0.169.8819.629.32Jul 19, 2023

Evaluation results

MethodLinks
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.0737.6
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.0736.3
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.0734.6
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.0710.9
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.076.9
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.076.6
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.076
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.075.3
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.074.4
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.073.8
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.073
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.072.7
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.072.1
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.071.9
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.071.7
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.071.6