Multi-modal Retrieval on WebQA
84.7Recall@5CLIP-SF
Evaluation results
| Method | Links | |
|---|---|---|
| CLIP-SFRetrieval Strategy=Embedding-based, Fusion Strategy=Score-level Fusion, Re-ranking=false, Retrieval Pool=Task-specific2025.03 | 84.7 | |
| BLIP-FFRetrieval Strategy=Embedding-based, Fusion Strategy=Feature-level Fusion, Re-ranking=false, Retrieval Pool=Task-specific2025.03 | 80 | |
| BLIP-FFRetrieval Strategy=Embedding-based, Fusion Strategy=Feature-level Fusion, Re-ranking=false, Retrieval Pool=Task-specific2025.03 | 79.8 | |
| BLIP-FFApproach=Embedding-based, Fusion=FF2025.03 | 79.7 | |
| CLIP-SFApproach=Embedding-based, Fusion=SF2025.03 | 78.8 | |
| CLIP-SFRetrieval Strategy=Embedding-based, Fusion Strategy=Score-level Fusion, Re-ranking=false, Retrieval Pool=Task-specific2025.03 | 78.7 | |
| GENIUSRetrieval Strategy=Generative, Fusion Strategy=None, Re-ranking=true, Retrieval Pool=Task-specific2025.03 | 60.6 | |
| VISTA#Params=196M, Zero-shot=true2024.06 | 60.11 | |
| GENIUSApproach=Generative, Re-ranking=true2025.03 | 59.7 | |
| GENIUSRetrieval Strategy=Generative, Fusion Strategy=None, Re-ranking=false, Retrieval Pool=Task-specific2025.03 | 49.7 | |
| GENIUSApproach=Generative2025.03 | 49 | |
| GENIUSRetrieval Strategy=Generative, Fusion Strategy=None, Re-ranking=true, Retrieval Pool=Task-specific2025.03 | 44.6 | |
| GENIUSRetrieval Strategy=Generative, Fusion Strategy=None, Re-ranking=false, Retrieval Pool=Task-specific2025.03 | 32.5 | |
| BLIP-MM#Params=224M, Zero-shot=true, Multi-modal Training (Generated Data)=true2024.06 | 30.11 | |
| CLIP-MM#Params=149M, Zero-shot=true, Multi-modal Training (Generated Data)=true2024.06 | 28.77 | |
| Pic2Word-MM#Params=224M, Zero-shot=true, Multi-modal Training (Generated Data)=true2024.06 | 24.15 | |
| Pic2Word#Params=224M, Zero-shot=true, Multi-modal Training (Generated Data)=false2024.06 | 12.72 | |
| CLIP#Params=149M, Zero-shot=true, Multi-modal Training (Generated Data)=false2024.06 | 10.54 | |
| BLIP#Params=224M, Zero-shot=true, Multi-modal Training (Generated Data)=false2024.06 | 10.03 |