Knowledge-based Visual Retrieval on ReMuQ 1.0 (test)
83.06MRR@5MIRe
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MIReZero-shot=true2024.11 | 83.06 | 86.84 | 88.56 | |
| MIReZero-shot=true, Backbone=ViT-large2024.11 | 82.56 | 86.48 | 88.17 | |
| UniIRZero-shot=true2024.11 | 79.15 | 84.34 | 86.62 | |
| VISTAZero-shot=true2024.11 | 78.32 | 84.21 | 87.03 | |
| FLMRZero-shot=true2024.11 | 66.67 | 72.1 | 74.95 | |
| PreFLMR†Zero-shot=true, Pre-training=trained on same dataset and experimental settings as current paper2024.11 | 52.27 | 54.31 | 55.06 | |
| ReVizZero-shot=true2024.11 | 23.61 | 39.43 | 46.77 | |
| CLIPZero-shot=true2024.11 | 0.34 | 0.78 | 1.36 |