Single-document retrieval on QASA
57.74F1 ScoreAttentionRetriever
Evaluation results
| Method | Links | |
|---|---|---|
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=22026.02 | 57.74 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=22026.02 | 57.04 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=32026.02 | 56.63 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=32026.02 | 55.84 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=12026.02 | 55.83 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=12026.02 | 54.77 | |
| Qwen3top_k=12026.02 | 53.23 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=52026.02 | 51.55 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=52026.02 | 51.33 | |
| GritLMtop_k=12026.02 | 51.05 | |
| Qwen3top_k=22026.02 | 49.63 | |
| GritLMtop_k=22026.02 | 47.62 | |
| SPScannertop_k=22026.02 | 47.32 | |
| GTRtop_k=12026.02 | 46.43 | |
| SPScannertop_k=32026.02 | 46.04 | |
| SPScannertop_k=12026.02 | 45.51 | |
| BM25top_k=12026.02 | 45.3 | |
| Qwen3top_k=32026.02 | 44.14 | |
| GTRtop_k=22026.02 | 43.97 | |
| GritLMtop_k=32026.02 | 43.94 | |
| BM25top_k=22026.02 | 42.55 | |
| GTE-Qwen2top_k=12026.02 | 42.3 | |
| ANCEtop_k=12026.02 | 42.16 | |
| GTE-Qwen2top_k=22026.02 | 41 | |
| SPScannertop_k=52026.02 | 40.6 | |
| ANCEtop_k=22026.02 | 40.28 | |
| GTRtop_k=32026.02 | 39.77 | |
| BM25top_k=32026.02 | 37.95 | |
| GTE-Qwen2top_k=32026.02 | 37.85 | |
| ANCEtop_k=32026.02 | 37.24 | |
| GritLMtop_k=52026.02 | 35.73 | |
| Qwen3top_k=52026.02 | 35.46 | |
| GTRtop_k=52026.02 | 32.34 | |
| GTE-Qwen2top_k=52026.02 | 31.33 | |
| BM25top_k=52026.02 | 30.87 | |
| ANCEtop_k=52026.02 | 30.19 | |
| DPRtop_k=32026.02 | 21.81 | |
| DPRtop_k=22026.02 | 21.38 | |
| DPRtop_k=52026.02 | 20.55 | |
| DPRtop_k=12026.02 | 19.79 | |
| CDEtop_k=32026.02 | 13.41 | |
| CDEtop_k=52026.02 | 12.93 | |
| CDEtop_k=22026.02 | 11.99 | |
| CDEtop_k=12026.02 | 10.61 |