Image-to-text retrieval on NoCaps
90.9R@1InfoMetIC+
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| InfoMetIC+combined with CLIP similarity=true2023.05 | 90.9 | 98.8 | 99.7 | |
| CLIP-S2023.05 | 88.2 | 98.3 | 99.7 | |
| VladVABackbone=LLAVA-1.5-7B, Zero-shot=true2024.12 | 85.7 | — | 99.5 | |
| EVA-CLIPParameters=18B, Zero-shot=true2024.12 | 85.6 | — | 99.2 | |
| EVA-CLIPParameters=8B, Zero-shot=true2024.12 | 83.5 | — | 98.6 | |
| EVA-02-CLIPBackbone=ViT-E/14+, Zero-shot=true2024.12 | 83 | — | 98.9 | |
| OpenCLIPBackbone=ViT-BigG/14, Zero-shot=true2024.12 | 82.3 | — | 98.8 | |
| OpenCLIPBackbone=ViT-G/14, Zero-shot=true2024.12 | 81 | — | 98.7 | |
| VLM2VecBackbone=Mistral-7B, Zero-shot=true2024.12 | 79.2 | — | 98.5 | |
| InfoMetIC2023.05 | 76.6 | 96.5 | 99.1 | |
| E5-VBackbone=LLAVA-Next-8B, Zero-shot=true2024.12 | 74.9 | — | 98.3 | |
| BLIP2Backbone=ViT-L, Zero-shot=true2024.12 | 74.4 | — | 98.3 | |
| BLIPBackbone=ViT-L, Zero-shot=true2024.12 | 72.1 | — | 97.7 | |
| E5-VBackbone=LLAVA-1.5-7B, Zero-shot=true2024.12 | 71.9 | — | 97 | |
| CLIPBackbone=ViT-L, Zero-shot=true2024.12 | 70 | — | 96.2 | |
| TIGER2023.05 | 63.8 | 87 | 92.4 | |
| LLaVA-1.5-7BZero-shot=true2024.12 | 52.1 | — | 88.1 |