Open-domain Question Answering on NQ (dev)
517.6WordsTop 5 documents
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Top 5 documentsRetrieval Strategy=Retrieval without Noise Filtering, Documents=Top 52024.06 | 517.6 | 14.7 | 55.8 | 9 | 48.4 | -4.21 | |
| LONGLLMLINGUARetrieval Strategy=Retrieval with Filtering Method, Filtering Method=LONGLLMLINGUA2024.06 | 141.1 | 14.7 | 47.3 | 7.4 | 49.9 | -4.27 | |
| Top 1 documentRetrieval Strategy=Retrieval without Noise Filtering, Documents=Top 12024.06 | 103.6 | 13.4 | 56.8 | 7.7 | 51 | -4.29 | |
| RANKGPTRetrieval Strategy=Retrieval with Filtering Method, Filtering Method=RANKGPT2024.06 | 103.6 | 16.5 | 51 | 10.3 | 53.7 | -4.47 | |
| LLAMA2-7BRetrieval Strategy=Retrieval with Filtering Method, Filtering Method=LLAMA2-7B2024.06 | 37.3 | 18.3 | 43.7 | 11 | 52.2 | -4.53 | |
| Ours w/SFT w/DPORetrieval Strategy=Retrieval with Filtering Method, Fine-tuning protocol=SFT w/ DPO2024.06 | 12.7 | 21.5 | 20.3 | 10.2 | 55.9 | -4.78 | |
| Ours w/SFTRetrieval Strategy=Retrieval with Filtering Method, Fine-tuning protocol=SFT2024.06 | 10.3 | 20.6 | 17.6 | 8.7 | 54.9 | -4.6 | |
| LLAMA2-13BRetrieval Strategy=No Retrieval, Generator=LLAMA2-13B2024.06 | 0 | 16.2 | — | — | 51.4 | -4.46 |