Single-document retrieval on RepLiQA
0.8555F1 ScoreAttentionRetriever
Evaluation Results
| Method | Links | |
|---|---|---|
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=12026.02 | 0.8555 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=12026.02 | 0.855 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=22026.02 | 0.8454 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=32026.02 | 0.8422 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=22026.02 | 0.8394 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=32026.02 | 0.8339 | |
| GritLMtop_k=12026.02 | 0.8312 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=52026.02 | 0.8093 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=52026.02 | 0.8009 | |
| BM25top_k=12026.02 | 0.7862 | |
| GTRtop_k=12026.02 | 0.7568 | |
| ANCEtop_k=12026.02 | 0.7364 | |
| Qwen3top_k=12026.02 | 0.7218 | |
| SPScannertop_k=22026.02 | 0.721 | |
| SPScannertop_k=12026.02 | 0.7139 | |
| GTE-Qwen2top_k=12026.02 | 0.7011 | |
| GritLMtop_k=22026.02 | 0.6473 | |
| SPScannertop_k=32026.02 | 0.6434 | |
| BM25top_k=22026.02 | 0.6133 | |
| GTRtop_k=22026.02 | 0.6035 | |
| Qwen3top_k=22026.02 | 0.595 | |
| GTE-Qwen2top_k=22026.02 | 0.5841 | |
| ANCEtop_k=22026.02 | 0.5826 | |
| GritLMtop_k=32026.02 | 0.5141 | |
| SPScannertop_k=52026.02 | 0.4965 | |
| BM25top_k=32026.02 | 0.4896 | |
| GTRtop_k=32026.02 | 0.4851 | |
| Qwen3top_k=32026.02 | 0.4846 | |
| GTE-Qwen2top_k=32026.02 | 0.4785 | |
| ANCEtop_k=32026.02 | 0.4686 | |
| DPRtop_k=12026.02 | 0.4655 | |
| DPRtop_k=22026.02 | 0.4177 | |
| GritLMtop_k=52026.02 | 0.3616 | |
| DPRtop_k=32026.02 | 0.3602 | |
| Qwen3top_k=52026.02 | 0.3496 | |
| BM25top_k=52026.02 | 0.3475 | |
| GTE-Qwen2top_k=52026.02 | 0.3467 | |
| GTRtop_k=52026.02 | 0.3466 | |
| ANCEtop_k=52026.02 | 0.3372 | |
| DPRtop_k=52026.02 | 0.2827 | |
| CDEtop_k=22026.02 | 0.2598 | |
| CDEtop_k=12026.02 | 0.2535 | |
| CDEtop_k=32026.02 | 0.2449 | |
| CDEtop_k=52026.02 | 0.2129 |