List your company
ResearchFormerly WizWand

Open-domain QA on HotpotQA

47QA-F1UnifiedQA-3b
0.61612.65824.736.742Jul 19, 2023
Updated 8mo ago

Evaluation results

MethodLinks
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.0747
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.0742.7
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.0740.3
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.0717
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.0714.2
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.0713.1
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.0711.4
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.079.1
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.076.8
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.076.6
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.076
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.075.9
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.075.1
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.075.1
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.074.9
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.072.4