Open-domain multimodal component retrieval on MULTIMODALQADoc
43.91R@1FIF
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FIFType=Agentic2026.02 | 43.91 | 61.78 | 74.83 | 80.79 | 87.77 | |
| FIFType=Agentic2026.02 | 42.17 | 57.58 | 74.88 | 85.82 | 86.82 | |
| IRCoTType=Agentic2026.02 | 40.85 | 56.73 | 68.78 | 73.72 | 83.15 | |
| IRCoTType=Agentic2026.02 | 39.56 | 55.09 | 69.87 | 74.97 | 82.24 | |
| ColPaliType=Single-shot embedding-based2026.02 | 38.38 | 52.61 | 61.73 | 63.95 | 67.65 | |
| ColPaliType=Single-shot embedding-based2026.02 | 35.21 | 46.9 | 53.37 | 57.78 | 56.9 | |
| VisRAGType=Single-shot embedding-based2026.02 | 34.19 | 42.12 | 53.38 | 56.91 | 57.88 | |
| LILACType=Agentic2026.02 | 33.59 | 50.59 | 65.13 | 72.23 | 79.12 | |
| LILACType=Agentic2026.02 | 32.67 | 45.35 | 57.77 | 64.23 | 77.87 | |
| NV-Embed-v2Type=Single-shot embedding-based2026.02 | 26.42 | 37.63 | 52.08 | 61.45 | 68.13 | |
| VisRAGType=Single-shot embedding-based2026.02 | 25.58 | 41.46 | 46.1 | 48.75 | 50.6 | |
| NV-Embed-v2Type=Single-shot embedding-based2026.02 | 22.18 | 31.38 | 39.8 | 51.19 | 55.81 |