List your company
ResearchFormerly WizWand

Open-domain Question Answering on TriviaQA (TQA) (test)

77.1AccuracyFusion-in-Decoder
49.0256.3163.670.89Oct 12, 2021Dec 18, 2021Feb 23, 2022May 1, 2022Jul 7, 2022Sep 12, 2022Nov 18, 2022
Updated 8mo ago

Evaluation results

MethodLinks
Fusion-in-Decoder#Params=440M, #Encoded=1002021.1077.1
FiE + PAQModel Type=Extractive, # Params=330M2022.1172.6
FiD-KDModel Type=Generative, # Params=770M2022.1172.1
FiEModel Type=Extractive, # Params=330M2022.1171.6
EMDR2Model Type=Generative, # Params=220M2022.1171.4
UnitedQAModel Type=Hybrid, # Params=1.87B2022.1170.5
R2-D2Model Type=Hybrid, # Params=1.29B2022.1169.9
KG-FiDModel Type=Generative, # Params=770M2022.1169.8
UnitedQAModel Type=Extractive, # Params=330M2022.1168.9
FiD-KDModel Type=Generative, # Params=220M2022.1168.8
FiEModel Type=Extractive, # Params=110M2022.1168.2
FiE + PAQModel Type=Extractive, # Params=110M2022.1168.2
RAG#Params=620M, #Encoded=1002021.1068
FiDModel Type=Generative, # Params=770M2022.1167.6
REALM#Params=330M, #Encoded=52021.1067.1
KG-FiDModel Type=Generative, # Params=220M2022.1166.7
UnitedQAModel Type=Extractive, # Params=110M2022.1166.3
TOME-2#Params=220M, #Encoded=12021.1065.8
FiDModel Type=Generative, # Params=220M2022.1165
R1-D1Model Type=Extractive, # Params=330M2022.1165
TOME-1#Params=220M, #Encoded=12021.1061.1
ANCEModel Type=Extractive, # Params=110M2022.1157.5
DPRModel Type=Extractive, # Params=110M2022.1156.8
RAGModel Type=Generative, # Params=400M2022.1156.1
Entities as Experts#Params=360M, #Encoded=12021.1053.4
T5-11B#Params=11B, #Encoded=12021.1050.1