Scientific literature retrieval on MMDocIR Scientific (test)
60Recall@1UniRank
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| UniRankSize=8B2026.02 | 60 | 84.4 | 95.6 | 60 | 70.7 | 74.3 | 74.4 | |
| MM-R5Size=8B2026.02 | 51.1 | 73.3 | 80 | 51.1 | 59.1 | 63 | 63.4 | |
| jina-reranker-m0Size=2B2026.02 | 48.9 | 75.6 | 88.9 | 48.9 | 61.7 | 67.1 | 64.5 | |
| BGE-Reranker-v2-m3Size=0.6B, Input transformation=VLM-text2026.02 | 37.8 | 66.7 | 73.3 | 37.8 | 48.2 | 52 | 52.3 | |
| Qwen3-RerankerSize=8B, Input transformation=OCR-text2026.02 | 37.8 | 66.7 | 77.8 | 37.8 | 49.7 | 53.8 | 53.6 | |
| Qwen3-VL-RerankerSize=8B2026.02 | 37.8 | 64.4 | 66.7 | 37.8 | 49.5 | 50.7 | 52 | |
| Qwen3-RerankerSize=8B, Input transformation=VLM-text2026.02 | 35.6 | 60 | 71.1 | 35.6 | 48.7 | 52.6 | 50.6 | |
| BGE-Reranker-v2-m3Size=0.6B, Input transformation=OCR-text2026.02 | 26.7 | 40 | 57.8 | 26.7 | 30.5 | 38.1 | 38.3 |