Information Retrieval Reranking on BeIR collection 12 datasets
60.2nDCG@10Qwen3-4B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-4BLen.=2048, Reranking Strategy=Pointwise2026.04 | 60.2 | 17 | 1 | |
| Jina-v3 (QWEN3-0.6B)Len.=-1, Reranking Strategy=Listwise2026.04 | 59.8 | 11 | 0.72 | |
| Qwen2.5-8BLen.=512, Compression=None, Reranking Strategy=Pointwise2026.04 | 59.7 | 20 | 1.26 | |
| Qwen3-4BLen.=1024, Reranking Strategy=Pointwise2026.04 | 59.6 | 14 | 0.84 | |
| Jina-v3 (QWEN3-0.6B)Len.=1024, Reranking Strategy=Listwise2026.04 | 59 | 8 | 0.53 | |
| RRKLen.=512, Reranking Strategy=Listwise2026.04 | 58.4 | 1 | 0.06 | |
| Qwen3-4BLen.=512, Reranking Strategy=Pointwise2026.04 | 58.4 | 10 | 0.64 | |
| Jina-v3 (QWEN3-0.6B)Len.=512, Reranking Strategy=Listwise2026.04 | 57.6 | 6 | 0.44 | |
| RRKLen.=512, Reranking Strategy=Pointwise2026.04 | 57.5 | 3 | 0.21 | |
| Qwen3-0.6BLen.=2048, Reranking Strategy=Pointwise2026.04 | 57.3 | 5 | 0.31 | |
| ModernBert-LargeLen.=512, Compression=None, Reranking Strategy=Pointwise2026.04 | 57.2 | 2 | 0.13 | |
| Qwen3-0.6BLen.=1024, Reranking Strategy=Pointwise2026.04 | 56.9 | 4 | 0.24 | |
| Qwen3-0.6BLen.=512, Reranking Strategy=Pointwise2026.04 | 55.1 | 3 | 0.18 |