Single-document retrieval on ConditionalQA
35.28F1AttentionRetriever
Evaluation results
| Method | Links | |
|---|---|---|
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=52026.02 | 35.28 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=32026.02 | 35.26 | |
| GritLMtop_k=32026.02 | 32.58 | |
| GritLMtop_k=22026.02 | 32.38 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=22026.02 | 31.58 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=52026.02 | 31.25 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=32026.02 | 31.06 | |
| GritLMtop_k=52026.02 | 29.71 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=22026.02 | 29.3 | |
| Qwen3top_k=32026.02 | 28.92 | |
| GritLMtop_k=12026.02 | 28.9 | |
| Qwen3top_k=22026.02 | 28.83 | |
| Qwen3top_k=12026.02 | 28.1 | |
| Qwen3top_k=52026.02 | 26.86 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=12026.02 | 26.79 | |
| GTRtop_k=22026.02 | 26.22 | |
| GTRtop_k=32026.02 | 25.84 | |
| GTRtop_k=52026.02 | 25.14 | |
| GTE-Qwen2top_k=32026.02 | 24.15 | |
| GTE-Qwen2top_k=52026.02 | 23.88 | |
| GTRtop_k=12026.02 | 23.66 | |
| GTE-Qwen2top_k=22026.02 | 23.16 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=12026.02 | 22.2 | |
| GTE-Qwen2top_k=12026.02 | 21.88 | |
| BM25top_k=52026.02 | 20.44 | |
| BM25top_k=32026.02 | 19.88 | |
| ANCEtop_k=52026.02 | 19.45 | |
| ANCEtop_k=22026.02 | 18.98 | |
| ANCEtop_k=32026.02 | 18.93 | |
| ANCEtop_k=12026.02 | 18.04 | |
| BM25top_k=22026.02 | 17.14 | |
| DPRtop_k=52026.02 | 16.89 | |
| SPScannertop_k=52026.02 | 15.82 | |
| CDEtop_k=32026.02 | 15.47 | |
| CDEtop_k=52026.02 | 15.47 | |
| DPRtop_k=32026.02 | 15.42 | |
| DPRtop_k=22026.02 | 14.7 | |
| CDEtop_k=22026.02 | 14.19 | |
| BM25top_k=12026.02 | 14.12 | |
| SPScannertop_k=32026.02 | 13.54 | |
| SPScannertop_k=22026.02 | 12.2 | |
| DPRtop_k=12026.02 | 11.89 | |
| CDEtop_k=12026.02 | 10.25 | |
| SPScannertop_k=12026.02 | 6.56 |