Long Document Retrieval on LongBench Retrieval v2 (full)
0.4843F1 ScoreAttentionRetriever
Evaluation results
| Method | Links | |
|---|---|---|
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=22026.02 | 0.4843 | |
| AttentionRetrieverBackbone=LLaMA-3.2 3B2026.02 | 0.4738 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=32026.02 | 0.4738 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=52026.02 | 0.4576 | |
| SPScannertop_k=22026.02 | 0.4386 | |
| SPScannerModel Type=Autoregressive2026.02 | 0.4188 | |
| SPScannertop_k=32026.02 | 0.4188 | |
| SPScannertop_k=12026.02 | 0.3878 | |
| AttentionRetrieverbackbone=LLaMA-3.2 3B, top_k=12026.02 | 0.384 | |
| GritLMtop_k=22026.02 | 0.3799 | |
| GTE-Qwen2top_k=22026.02 | 0.3792 | |
| GritLMtop_k=12026.02 | 0.365 | |
| SPScannertop_k=52026.02 | 0.3605 | |
| GTRtop_k=22026.02 | 0.3597 | |
| BM25top_k=12026.02 | 0.3576 | |
| ANCEtop_k=22026.02 | 0.35 | |
| GTE-Qwen2top_k=12026.02 | 0.3435 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=52026.02 | 0.3416 | |
| GritLMModel Type=Dense2026.02 | 0.3398 | |
| GritLMtop_k=32026.02 | 0.3398 | |
| Qwen3top_k=22026.02 | 0.3365 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=22026.02 | 0.3349 | |
| GTE-Qwen2Model Type=Dense2026.02 | 0.3314 | |
| GTE-Qwen2top_k=32026.02 | 0.3314 | |
| BM25top_k=22026.02 | 0.3296 | |
| ANCEtop_k=12026.02 | 0.3269 | |
| GTRModel Type=Dense2026.02 | 0.326 | |
| GTRtop_k=32026.02 | 0.326 | |
| ANCEModel Type=Dense2026.02 | 0.324 | |
| ANCEtop_k=32026.02 | 0.324 | |
| AttentionRetrieverBackbone=Qwen-2.5 3B2026.02 | 0.3215 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=32026.02 | 0.3215 | |
| Qwen3Model Type=Dense2026.02 | 0.3205 | |
| Qwen3top_k=32026.02 | 0.3205 | |
| Qwen3top_k=12026.02 | 0.3151 | |
| BM25Model Type=Sparse2026.02 | 0.3126 | |
| BM25top_k=32026.02 | 0.3126 | |
| GTRtop_k=12026.02 | 0.3118 | |
| GritLMtop_k=52026.02 | 0.3055 | |
| Qwen3top_k=52026.02 | 0.2877 | |
| GTRtop_k=52026.02 | 0.2846 | |
| GTE-Qwen2top_k=52026.02 | 0.2823 | |
| BM25top_k=52026.02 | 0.2703 | |
| ANCEtop_k=52026.02 | 0.2584 | |
| DPRModel Type=Dense2026.02 | 0.1226 | |
| DPRtop_k=32026.02 | 0.1226 | |
| DPRtop_k=22026.02 | 0.1139 | |
| DPRtop_k=52026.02 | 0.1073 | |
| DPRtop_k=12026.02 | 0.09 | |
| AttentionRetrieverbackbone=Qwen-2.5 3B, top_k=12026.02 | 0.0891 | |
| CDEtop_k=52026.02 | 0.0521 | |
| CDEModel Type=Dense2026.02 | 0.0485 | |
| CDEtop_k=32026.02 | 0.0485 | |
| CDEtop_k=12026.02 | 0.0452 | |
| CDEtop_k=22026.02 | 0.0443 |