Open-domain QA on NaturalQuestions (NQ) top 1000 samples (test)
40.3Exact MatchBIDER
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BIDERrefinement_type=Abstractive refinement2024.02 | 40.3 | 77 | |
| Bge-Rerankerrefinement_type=Extractive refinement, additional_training=true2024.02 | 38 | 164 | |
| LLM-Embedderrefinement_type=Extractive refinement2024.02 | 35.7 | 161 | |
| Original Promptrefinement_type=Without refinement2024.02 | 35.6 | 725 | |
| SBERTrefinement_type=Extractive refinement2024.02 | 33.9 | 162 | |
| BART-Summarizerrefinement_type=Abstractive refinement2024.02 | 32.6 | 185 | |
| BM25refinement_type=Extractive refinement2024.02 | 29.5 | 163 | |
| Selective-Contextrefinement_type=Abstractive refinement2024.02 | 26.3 | 203 | |
| LongLLMLinguarefinement_type=Abstractive refinement2024.02 | 22.1 | 251 | |
| Zero-shotrefinement_type=Without refinement2024.02 | 18.9 | 0 |