Single-document retrieval on NaturalQuestions
60.65F1 ScoreAttentionRetriever
Evaluation results
| Method | Links | |
|---|---|---|
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=12026.02 | 60.65 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=22026.02 | 60.1 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=32026.02 | 59.98 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=52026.02 | 58.1 | |
| GritLMtop_k=12026.02 | 57.97 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=22026.02 | 57.09 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=32026.02 | 56.55 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=52026.02 | 54.68 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=12026.02 | 54.48 | |
| GritLMtop_k=22026.02 | 53.51 | |
| GTE-Qwen2top_k=12026.02 | 49.24 | |
| GTRtop_k=12026.02 | 48.96 | |
| GTE-Qwen2top_k=22026.02 | 47.51 | |
| Qwen3top_k=12026.02 | 46.98 | |
| GTRtop_k=22026.02 | 46.32 | |
| Qwen3top_k=22026.02 | 45.92 | |
| GritLMtop_k=32026.02 | 45.92 | |
| ANCEtop_k=12026.02 | 43.09 | |
| SPScannertop_k=22026.02 | 42.68 | |
| SPScannertop_k=32026.02 | 42.37 | |
| ANCEtop_k=22026.02 | 42.23 | |
| GTE-Qwen2top_k=32026.02 | 41.31 | |
| GTRtop_k=32026.02 | 41.1 | |
| Qwen3top_k=32026.02 | 40.91 | |
| SPScannertop_k=52026.02 | 38.93 | |
| SPScannertop_k=12026.02 | 38.62 | |
| ANCEtop_k=32026.02 | 38.18 | |
| GritLMtop_k=52026.02 | 34.45 | |
| GTRtop_k=52026.02 | 32.85 | |
| BM25top_k=22026.02 | 32.84 | |
| Qwen3top_k=52026.02 | 31.86 | |
| BM25top_k=12026.02 | 31.74 | |
| GTE-Qwen2top_k=52026.02 | 31.74 | |
| ANCEtop_k=52026.02 | 30.84 | |
| BM25top_k=32026.02 | 30.55 | |
| DPRtop_k=22026.02 | 30.28 | |
| DPRtop_k=32026.02 | 29.81 | |
| DPRtop_k=12026.02 | 27.43 | |
| DPRtop_k=52026.02 | 26.94 | |
| BM25top_k=52026.02 | 25.72 | |
| CDEtop_k=32026.02 | 24.16 | |
| CDEtop_k=22026.02 | 23.98 | |
| CDEtop_k=52026.02 | 22.11 | |
| CDEtop_k=12026.02 | 21.17 |