Knowledge-based Visual Retrieval on E-VQA 1.0 (test)
0.4492MRR@5MIRe
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MIReZero-shot=true, Backbone=ViT-large2024.11 | 0.4492 | 0.5765 | 0.644 | |
| MIReZero-shot=true2024.11 | 0.4188 | 0.5424 | 0.6101 | |
| VISTAZero-shot=true2024.11 | 0.339 | 0.4773 | 0.5672 | |
| UniIRZero-shot=true2024.11 | 0.3159 | 0.4421 | 0.5531 | |
| PreFLMR†Zero-shot=true, Pre-training=trained on same dataset and experimental settings as current paper2024.11 | 0.3092 | 0.4171 | 0.4944 | |
| FLMRZero-shot=true2024.11 | 0.2997 | 0.42 | 0.5075 |