List your company

Open-domain QA on Curated TREC

41.8QA-F1UnifiedQA-3b
-0.63210.38421.432.416Jul 19, 2023

Evaluation results

MethodLinks
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.0741.8
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.0736.9
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.0736.6
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.0716
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.079.9
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.078.2
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.077.4
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.073.8
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.073.6
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.073
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.072.7
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.072.5
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.072.4
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.072
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.071.9
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.071