Knowledge-based Visual Retrieval on OKVQA Google Search (test)
84.66PR@5MIRe
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MIReMode=Fine-tuning, Backbone=ViT-large2024.11 | 84.66 | — | 91.3 | |
| MIReMode=Fine-tuning2024.11 | 83.59 | — | 90.59 | |
| VISTAMode=Fine-tuning2024.11 | 82.06 | — | 90.11 | |
| MIReZero-shot=true, Backbone=ViT-large2024.11 | 81.13 | 63.17 | 88.72 | |
| MIReZero-shot=true2024.11 | 80.48 | 63.03 | 88.15 | |
| GeMKRMode=Fine-tuning2024.11 | 78.6 | — | 86.2 | |
| PreFLMR†Zero-shot=true, Pre-training=trained on same dataset and experimental settings as current paper2024.11 | 76.83 | 59.38 | 84.34 | |
| MIReMode=Fine-tuning, Pre-training=None2024.11 | 74.26 | — | 84.07 | |
| UniIRZero-shot=true2024.11 | 73.94 | 53.27 | 84.19 | |
| ReVizMode=Fine-tuning2024.11 | 73.35 | — | 83.17 | |
| VISTAZero-shot=true2024.11 | 72.83 | 55.33 | 81.61 | |
| VRRMode=Fine-tuning2024.11 | 71.5 | — | 81.5 | |
| FLMRMode=Fine-tuning2024.11 | 70.63 | — | 81.23 | |
| ReVizZero-shot=true2024.11 | 64.05 | 45.77 | 75.39 | |
| FLMRZero-shot=true2024.11 | 57.25 | 38.15 | 69.42 | |
| CLIPZero-shot=true2024.11 | 34.54 | 19.08 | 50.48 |