Open-domain Question Answering on TriviaQA (EM, F1, tokens)
59.36Exact Match (EM)Oracle
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OracleRetrieval Strategy=Adaptive Compression, Generator=LLAMA2-7B2024.09 | 59.36 | 261 | 83.98 | |
| Top-5 documentsRetrieval Strategy=Retrieval without Compression, Generator=LLAMA2-7B2024.09 | 48.58 | 808 | 80.2 | |
| AdaCompRetrieval Strategy=Adaptive Compression, Generator=LLAMA2-7B2024.09 | 47.15 | 468 | 79.4 | |
| ONLY_DOCRetrieval Strategy=Retrieval with Compression, Generator=LLAMA2-7B2024.09 | 44.6 | 166 | 77.86 | |
| Top-1 documentRetrieval Strategy=Retrieval without Compression, Generator=LLAMA2-7B2024.09 | 43.57 | 160 | 77.51 | |
| RECOMPRetrieval Strategy=Retrieval with Compression, Generator=LLAMA2-7B2024.09 | 41.77 | 74 | 76.17 | |
| FILCORetrieval Strategy=Retrieval with Compression, Generator=LLAMA2-7B2024.09 | 38.96 | 58 | 74.14 | |
| LLAMA2-7BRetrieval Strategy=No Retrieval, Generator=LLAMA2-7B2024.09 | 30.54 | — | 68.86 |