Question Answering on TriviaQA (TQA) (test)
79.8Exact MatchATLAS
Evaluation Results
| Method | Links | |
|---|---|---|
| ATLAS2022.12 | 79.8 | |
| CriSPOModel=Claude Sonnet, Shots=64-shot2024.10 | 72.1 | |
| FiDOConfig=L-XXL2022.12 | 70.7 | |
| CriSPOModel=Claude Sonnet, Shots=0-shot2024.10 | 70.6 | |
| FiD-LSource=ours2022.12 | 68.2 | |
| FiD-LSource=Izacard and Grave, 20212022.12 | 67.6 | |
| CriSPOModel=Claude Instant, Shots=64-shot2024.10 | 67.5 | |
| CriSPOModel=Claude Instant, Shots=0-shot2024.10 | 66.3 | |
| ManualModel=Claude Sonnet, Shots=64-shot2024.10 | 65 | |
| ManualModel=Claude Instant, Shots=64-shot2024.10 | 59.2 | |
| ManualModel=Claude Instant, Shots=0-shot2024.10 | 58.6 | |
| ManualModel=Claude Sonnet, Shots=0-shot2024.10 | 58.4 | |
| RAG2022.12 | 56.8 | |
| OPROModel=Claude Instant2024.10 | 53.7 | |
| T5-XXL2022.12 | 51.9 | |
| OPROModel=Claude Sonnet2024.10 | 41.8 |