Single-document retrieval on Qasper
50.3F1 ScoreAttentionRetriever
Evaluation results
| Method | Links | |
|---|---|---|
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=12026.02 | 50.3 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=12026.02 | 48.27 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=32026.02 | 46.18 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=22026.02 | 45.63 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=32026.02 | 45.51 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=22026.02 | 44.43 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=52026.02 | 42.7 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=52026.02 | 41.65 | |
| SPScannertop_k=22026.02 | 37.22 | |
| SPScannertop_k=32026.02 | 37.12 | |
| SPScannertop_k=52026.02 | 34.69 | |
| SPScannertop_k=12026.02 | 32.32 | |
| GritLMtop_k=22026.02 | 31 | |
| GritLMtop_k=32026.02 | 30.08 | |
| ANCEtop_k=22026.02 | 29.57 | |
| ANCEtop_k=12026.02 | 28.86 | |
| ANCEtop_k=32026.02 | 28.56 | |
| GritLMtop_k=52026.02 | 27.44 | |
| GritLMtop_k=12026.02 | 27.22 | |
| GTRtop_k=32026.02 | 27.14 | |
| GTRtop_k=22026.02 | 26.95 | |
| ANCEtop_k=52026.02 | 25.15 | |
| GTE-Qwen2top_k=32026.02 | 24.42 | |
| GTRtop_k=52026.02 | 24.25 | |
| GTE-Qwen2top_k=22026.02 | 23.92 | |
| BM25top_k=32026.02 | 23.04 | |
| GTRtop_k=12026.02 | 22.91 | |
| GTE-Qwen2top_k=52026.02 | 22.89 | |
| BM25top_k=22026.02 | 22.6 | |
| BM25top_k=52026.02 | 21.01 | |
| Qwen3top_k=32026.02 | 20.57 | |
| GTE-Qwen2top_k=12026.02 | 20.15 | |
| BM25top_k=12026.02 | 19.83 | |
| Qwen3top_k=52026.02 | 19.6 | |
| Qwen3top_k=22026.02 | 19.45 | |
| Qwen3top_k=12026.02 | 15.74 | |
| CDEtop_k=52026.02 | 9.87 | |
| CDEtop_k=22026.02 | 9.69 | |
| CDEtop_k=32026.02 | 9.62 | |
| CDEtop_k=12026.02 | 8.1 | |
| DPRtop_k=52026.02 | 6.08 | |
| DPRtop_k=32026.02 | 5.29 | |
| DPRtop_k=22026.02 | 4.62 | |
| DPRtop_k=12026.02 | 3.26 |