Open-domain QA on HotPotQA top 1000 samples (test)
38.6F1BIDER
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BIDERrefinement_type=Abstractive refinement2024.02 | 38.6 | 113 | |
| Bge-Rerankerrefinement_type=Extractive refinement, additional_training=true2024.02 | 38.4 | 186 | |
| Original Promptrefinement_type=Without refinement2024.02 | 37.6 | 770 | |
| BART-Summarizerrefinement_type=Abstractive refinement2024.02 | 36.9 | 254 | |
| SBERTrefinement_type=Extractive refinement2024.02 | 36 | 187 | |
| BM25refinement_type=Extractive refinement2024.02 | 35.6 | 186 | |
| LLM-Embedderrefinement_type=Extractive refinement2024.02 | 35.2 | 186 | |
| Selective-Contextrefinement_type=Abstractive refinement2024.02 | 33.2 | 234 | |
| LongLLMLinguarefinement_type=Abstractive refinement2024.02 | 30.2 | 222 | |
| Zero-shotrefinement_type=Without refinement2024.02 | 26.8 | 0 |