Multi-modal Information Retrieval on M-BEIR local pool setting
49.4q_t_to_c_i VN R@5U-MARVEL+
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| U-MARVEL+Inference Pipeline=+Reranker, Pool Setting=local pool2025.07 | 49.4 | 85.6 | 34.2 | 98.5 | 81.4 | 89.4 | 50.5 | 88.4 | 37.7 | 34.7 | 63.7 | 62.9 | 38.2 | 63.2 | 80.8 | 78.9 | 64.8 | |
| LamRAInference Pipeline=+Reranker, Pool Setting=local pool2025.07 | 48 | 85.2 | 32.9 | 96.7 | 75.8 | 87.7 | 48.6 | 92.3 | 36.1 | 33.5 | 59.2 | 64.1 | 37.8 | 63.3 | 79.2 | 78.3 | 63.7 | |
| U-MARVELInference Pipeline=Single model, Pool Setting=local pool2025.07 | 47.3 | 84.4 | 33.6 | 97.1 | 78.8 | 88.5 | 47.3 | 93.5 | 35.1 | 34.2 | 62.5 | 58.3 | 36.4 | 60.7 | 79.4 | 74.7 | 63.2 | |
| CLIP-LInference Pipeline=Single model, Pool Setting=local pool2025.07 | 43.3 | 61.1 | 6.6 | 36.2 | 43.3 | 45.1 | 41.3 | 79 | 7.7 | 26.1 | 24.2 | 20.5 | 7 | 13.2 | 38.8 | 26.4 | 32.5 | |
| UniIR-CLIPInference Pipeline=Single model, Pool Setting=local pool2025.07 | 42.6 | 81.1 | 18 | 84.7 | 59.4 | 78.7 | 43.1 | 92.3 | 18.3 | 32 | 45.5 | 27.9 | 24.4 | 44.6 | 67.6 | 48.9 | 50.6 | |
| LamRA-RetInference Pipeline=Single model, Pool Setting=local pool2025.07 | 41.6 | 81.5 | 28.7 | 86 | 62.6 | 81.2 | 39.6 | 90.6 | 30.4 | 32.1 | 54.1 | 52.1 | 33.2 | 53.1 | 76.2 | 63.3 | 56.6 | |
| SigLIPInference Pipeline=Single model, Pool Setting=local pool2025.07 | 30.1 | 75.7 | 36.5 | 39.8 | 27 | 43.5 | 30.8 | 88.2 | 34.2 | 28.9 | 29.7 | 25.1 | 14.4 | 22.7 | 41.7 | 27.4 | 37.2 | |
| UniIR-BLIPInference Pipeline=Single model, Pool Setting=local pool2025.07 | 23.4 | 79.7 | 26.1 | 80 | 50.9 | 79.8 | 22.8 | 89.9 | 28.9 | 33 | 41 | 22.4 | 29.2 | 52.2 | 55.8 | 33 | 46.8 |