Image-to-Text Retrieval on MS-COCO fine-tuned
83.7R@1BLIP-2 + MAFA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BLIP-2 + MAFAModel=BLIP-2 + MAFA, Evaluation protocol=fine-tuned2023.12 | 83.7 | 96.6 | 98.4 | |
| BLIP-2Backbone=ViT-L/16, Training data=400M, Storage per image=2,359 kB, Joint encoding parameters=167M, Inference time (ms)=98.642025.10 | 83.5 | — | — | |
| BLIP-2Model=BLIP-2, Evaluation protocol=fine-tuned2023.12 | 82.6 | 96.3 | 98.2 | |
| BLIPBackbone=ViT-L/16, Training data=129M, Storage per image=2,359 kB, Joint encoding parameters=139M, Inference time (ms)=101.612025.10 | 82.4 | — | — | |
| Local (EDJE)Backbone=ViT-L/16, Training data=12M, Storage per image=442kB, Joint encoding parameters=33M, Inference time (ms)=4.142025.10 | 81 | — | — | |
| Compressed-128 (EDJE)Backbone=ViT-L/16, Training data=12M, Storage per image=98kB, Joint encoding parameters=33M, Inference time (ms)=2.042025.10 | 81 | — | — | |
| Compressed-64 (EDJE)Backbone=ViT-L/16, Training data=12M, Storage per image=49kB, Joint encoding parameters=33M, Inference time (ms)=1.912025.10 | 80.9 | — | — | |
| BLIPBackbone=ViT-B/16, Training data=12M, Storage per image=1,769 kB, Joint encoding parameters=139M, Inference time (ms)=83.272025.10 | 80.6 | — | — | |
| ALBEFBackbone=ViT-B/16, Training data=12M, Storage per image=1,769 kB, Joint encoding parameters=147M, Inference time (ms)=45.922025.10 | 77.6 | — | — | |
| Local (EDJE)Backbone=ViT-B/16, Training data=12M, Storage per image=442kB, Joint encoding parameters=33M, Inference time (ms)=2.862025.10 | 76.1 | — | — | |
| BLIP-2 + GRITModel=BLIP-2 + GRIT, Evaluation protocol=fine-tuned2023.12 | 65.9 | 89.1 | 95 |