Hybrid Retrieval on ViDoRe 1
94.1Avg Performance ScoreGuided Query Refinement (GQR)
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Guided Query Refinement (GQR)2025.10 | 94.1 | 92 | 69.5 | 96.3 | 99 | 89 | 97.3 | 100 | 97.6 | 100 | 100 | |
| Score Aggregation (Min-Max)Tuned=true2025.10 | 93.5 | 92.3 | 69.3 | 96.3 | 99 | 88.7 | 96.6 | 99.5 | 93.8 | 99.1 | 100 | |
| Score Aggregation (SoftMax)Tuned=true2025.10 | 93.5 | 91.4 | 69.4 | 95.8 | 99 | 88.9 | 94.7 | 99.9 | 97.1 | 99.6 | 98.8 | |
| Average RankingTuned=true2025.10 | 92.9 | 92.2 | 68.7 | 95.6 | 98.8 | 87.6 | 95.2 | 99.9 | 93.3 | 98.2 | 100 | |
| Score Aggregation (Softmax)2025.10 | 92.5 | 87.4 | 63.5 | 94.5 | 99.1 | 87 | 96.1 | 100 | 97.3 | 100 | 100 | |
| Score Aggregation (Min-Max)2025.10 | 91.5 | 88.4 | 63.5 | 93.1 | 98.6 | 83 | 92.3 | 100 | 97.6 | 99.9 | 98.4 | |
| RRFTuned=true2025.10 | 91.5 | 90.9 | 66.2 | 93.5 | 98.8 | 85 | 92.4 | 99.5 | 92.8 | 98.2 | 97.2 | |
| Average Ranking2025.10 | 84.1 | 63.9 | 51.8 | 81.5 | 97.1 | 71.6 | 87.8 | 99.3 | 93.7 | 98 | 96.7 | |
| RRF2025.10 | 83.8 | 59.5 | 51.3 | 81.8 | 97.2 | 72.4 | 88.4 | 99 | 93.7 | 98.3 | 96.7 | |
| Guided Query Refinement (GQR)Average gain over 9 retriever pairs=true2025.10 | -0.1 | -0.4 | -0.7 | -0.1 | 0.1 | 0.1 | -0.1 | 0 | 0 | 0.1 | -0.2 | |
| Score Aggregation (Softmax)Tuned=true, Average gain over 9 retriever pairs=true2025.10 | -0.9 | -0.8 | -0.8 | -0.7 | -0.1 | 0 | -3.5 | -0.5 | -0.8 | -0.4 | -1.3 | |
| Score Aggregation (Min-Max)Tuned=true, Average gain over 9 retriever pairs=true2025.10 | -1.8 | -0.4 | -1.1 | -0.5 | -0.4 | -0.7 | -1.8 | -1.9 | -7.5 | -2.7 | -1 | |
| Score Aggregation (Softmax)Tuned=false, Average gain over 9 retriever pairs=true2025.10 | -2.1 | -5.8 | -8.1 | -2.2 | 0 | -2.3 | -2 | 0 | -0.1 | 0.2 | -0.4 | |
| Average RankingTuned=true, Average gain over 9 retriever pairs=true2025.10 | -5.5 | -10.1 | -8.9 | -6.6 | -1 | -7.2 | -4.5 | -1.8 | -8.1 | -4.3 | -2.1 | |
| RRFTuned=true, Average gain over 9 retriever pairs=true2025.10 | -6.6 | -13.4 | -11.4 | -7.7 | -0.9 | -8.5 | -6.2 | -2 | -8.4 | -4.3 | -3.8 | |
| Score Aggregation (Min-Max)Tuned=false, Average gain over 9 retriever pairs=true2025.10 | -7 | -15.8 | -15.7 | -8.1 | -1.2 | -13.5 | -7.6 | -1.7 | -2.2 | -1.1 | -3.1 | |
| RRFTuned=false, Average gain over 9 retriever pairs=true2025.10 | -14.6 | -39.1 | -29.9 | -17.9 | -3.2 | -23.1 | -12.2 | -3.5 | -6 | -5.2 | -5.7 | |
| Average RankingTuned=false, Average gain over 9 retriever pairs=true2025.10 | -14.7 | -37.1 | -29.9 | -18.1 | -3.3 | -23.9 | -12.8 | -3.7 | -6.6 | -5.6 | -6.3 |