Open-domain Question Answering on TriviaQA (TQA) (test)
77.1AccuracyFusion-in-Decoder
Evaluation Results
| Method | Links | |
|---|---|---|
| Fusion-in-Decoder#Params=440M, #Encoded=1002021.10 | 77.1 | |
| FiE + PAQModel Type=Extractive, # Params=330M2022.11 | 72.6 | |
| FiD-KDModel Type=Generative, # Params=770M2022.11 | 72.1 | |
| FiEModel Type=Extractive, # Params=330M2022.11 | 71.6 | |
| EMDR2Model Type=Generative, # Params=220M2022.11 | 71.4 | |
| UnitedQAModel Type=Hybrid, # Params=1.87B2022.11 | 70.5 | |
| R2-D2Model Type=Hybrid, # Params=1.29B2022.11 | 69.9 | |
| KG-FiDModel Type=Generative, # Params=770M2022.11 | 69.8 | |
| UnitedQAModel Type=Extractive, # Params=330M2022.11 | 68.9 | |
| FiD-KDModel Type=Generative, # Params=220M2022.11 | 68.8 | |
| FiEModel Type=Extractive, # Params=110M2022.11 | 68.2 | |
| FiE + PAQModel Type=Extractive, # Params=110M2022.11 | 68.2 | |
| RAG#Params=620M, #Encoded=1002021.10 | 68 | |
| FiDModel Type=Generative, # Params=770M2022.11 | 67.6 | |
| REALM#Params=330M, #Encoded=52021.10 | 67.1 | |
| KG-FiDModel Type=Generative, # Params=220M2022.11 | 66.7 | |
| UnitedQAModel Type=Extractive, # Params=110M2022.11 | 66.3 | |
| TOME-2#Params=220M, #Encoded=12021.10 | 65.8 | |
| FiDModel Type=Generative, # Params=220M2022.11 | 65 | |
| R1-D1Model Type=Extractive, # Params=330M2022.11 | 65 | |
| TOME-1#Params=220M, #Encoded=12021.10 | 61.1 | |
| ANCEModel Type=Extractive, # Params=110M2022.11 | 57.5 | |
| DPRModel Type=Extractive, # Params=110M2022.11 | 56.8 | |
| RAGModel Type=Generative, # Params=400M2022.11 | 56.1 | |
| Entities as Experts#Params=360M, #Encoded=12021.10 | 53.4 | |
| T5-11B#Params=11B, #Encoded=12021.10 | 50.1 |