Document Retrieval on ViDoRe V1
88.1Arxiv ScoreGuided Query Refinement (GQR)
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Guided Query Refinement (GQR)2025.10 | 88.1 | 62.5 | 93 | 96.6 | 80.2 | 90 | 99.6 | 96.1 | 96.5 | 98.8 | 90.1 | |
| Score Aggregation (Min-Max)Tuning=true2025.10 | 88 | 62.2 | 92.6 | 96.1 | 79.6 | 88.4 | 97.7 | 88.9 | 93.9 | 98 | 88.5 | |
| Score Aggregation (Softmax)Tuning=true2025.10 | 87.7 | 62.4 | 92.4 | 96.5 | 80.2 | 86.9 | 99.1 | 95.3 | 96 | 97.6 | 89.4 | |
| BaseBackbone=ColQwen2.5, Token=50462026.01 | 87.6 | 62.2 | 93.1 | 87.4 | 80.5 | 84.7 | 98.3 | 96 | 95.5 | 99.3 | 88.5 | |
| K-MeansBackbone=ColQwen2.5, Token=322026.01 | 83.7 | 52.4 | 86.1 | 86.6 | 67.2 | 72.5 | 93.2 | 92.1 | 88.9 | 92.8 | 81.6 | |
| BiQwen2Backbone=ColQwen2.5, Token=12026.01 | 83.3 | 51.6 | 82.9 | 83.3 | 66.1 | 72.3 | 94 | 86.1 | 92.5 | 95.2 | 80.7 | |
| Score Aggregation (Softmax)Tuning=false2025.10 | 83.3 | 57.7 | 91 | 96.5 | 78.3 | 88.2 | 99.6 | 96 | 96.6 | 98.6 | 88.6 | |
| SemClusterBackbone=ColQwen2.5, Token=322026.01 | 83.2 | 52.9 | 85.1 | 87.7 | 70.5 | 65.4 | 93.3 | 91.4 | 90.2 | 93.8 | 81.3 | |
| CausalQwenBackbone=ColQwen2.5, Token=322026.01 | 80.7 | 55.3 | 85.7 | 82.5 | 62 | 73.7 | 92.7 | 90.7 | 93.5 | 94.1 | 81.1 | |
| Average RankingTuning=true2025.10 | 79.5 | 57.3 | 87 | 95.5 | 74.4 | 86 | 97.8 | 88.3 | 92.3 | 96.9 | 85.5 | |
| RRFTuning=true2025.10 | 76.6 | 55.8 | 85.9 | 95.7 | 73.4 | 84.4 | 97.6 | 88 | 92.3 | 95.2 | 84.5 | |
| CausalPaliBackbone=ColPali, Token=322026.01 | 74.6 | 49.2 | 78.7 | 83.2 | 52 | 61.4 | 87.1 | 85.1 | 90.4 | 88.8 | 75 | |
| Score Aggregation (Min-Max)Tuning=false2025.10 | 74.4 | 53 | 85.5 | 95.4 | 69.4 | 83.2 | 97.9 | 94 | 95.4 | 95.9 | 84.4 | |
| 1D-PoolingBackbone=ColQwen2.5, Token=322026.01 | 73 | 43.2 | 82.9 | 79.1 | 61.4 | 62.5 | 88.3 | 87.3 | 87.3 | 93.1 | 75.8 | |
| RandomBackbone=ColQwen2.5, Token=322026.01 | 72.1 | 41.4 | 74.4 | 84.9 | 68.5 | 48.8 | 85.4 | 86.7 | 83.8 | 84.4 | 73 | |
| BaseBackbone=ColPali, Token=10312026.01 | 58.6 | 50.6 | 73.5 | 71 | 54.6 | 46.7 | 92.3 | 82.6 | 86.1 | 89.4 | 70.5 | |
| Average RankingTuning=false2025.10 | 55.6 | 44 | 76.2 | 93.4 | 61.1 | 78.5 | 96 | 89.8 | 91 | 92.7 | 77.8 | |
| SemClusterBackbone=ColPali, Token=322026.01 | 54 | 41 | 66.8 | 66.3 | 46.3 | 36.7 | 85.5 | 74 | 80.4 | 79.7 | 63.1 | |
| RRFTuning=false2025.10 | 53.8 | 44.1 | 76.5 | 93.5 | 61.7 | 79 | 96.1 | 90.3 | 91.4 | 93.3 | 78 | |
| K-MeansBackbone=ColPali, Token=322026.01 | 53.7 | 41.2 | 65.2 | 68.1 | 45 | 38.2 | 76.2 | 69.2 | 76.9 | 82.3 | 61.6 | |
| RandomBackbone=ColPali, Token=322026.01 | 46.4 | 28 | 57.7 | 65.6 | 43.5 | 18.7 | 79.1 | 68.7 | 67.7 | 77.9 | 55.4 | |
| 1D-PoolingBackbone=ColPali, Token=322026.01 | 46.1 | 28.8 | 59.8 | 52.6 | 36 | 20.5 | 80.3 | 64.6 | 78.4 | 73.1 | 54 | |
| BiPaliBackbone=ColPali, Token=12026.01 | 42.2 | 28.2 | 62.7 | 66.9 | 28.4 | 28.8 | 61.8 | 55.3 | 60.2 | 62.4 | 49.7 |