IMAGECODE on IMAGECODE (test)
90.8Performance (Image)Human Performance
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Human Performance2024.05 | 90.8 | — | — | |
| BLIP-2Evaluation Protocol=Zero-shot, Params=1.2B2024.05 | 79.2 | 29.4 | 16.3 | |
| ContextBLIPEvaluation Protocol=Fine-tune, Params=240M2024.05 | 78.5 | 35.7 | 24.4 | |
| BLIPEvaluation Protocol=Fine-tune, Params=223M2024.05 | 77.4 | 34.1 | 22.7 | |
| ContextBLIPEvaluation Protocol=Zero-shot, Params=240M2024.05 | 77.1 | 31 | 18.8 | |
| BLIPEvaluation Protocol=Zero-shot, Params=223M2024.05 | 74.4 | 28.1 | 15.9 | |
| ALBEFEvaluation Protocol=Zero-shot2024.05 | 73.3 | 27.7 | 15.7 | |
| NDCREvaluation Protocol=Fine-tune, Params=440M2024.05 | 64.3 | 34.1 | 26.1 | |
| CLIPEvaluation Protocol=Fine-tune, Params=473M2024.05 | 59.8 | 29.9 | 22 | |
| OFAEvaluation Protocol=Fine-tune2024.05 | 52.1 | 27.2 | 21 | |
| UNITEREvaluation Protocol=Fine-tune2024.05 | 50.5 | 25.7 | 19.1 | |
| ViLBERTEvaluation Protocol=Fine-tune2024.05 | 49.3 | 24.5 | 18 | |
| CLIPEvaluation Protocol=Zero-shot, Params=473M2024.05 | 47.8 | 22.4 | 15.6 | |
| UNITEREvaluation Protocol=Zero-shot2024.05 | 42.9 | 19.8 | 13.6 | |
| ViLBERTEvaluation Protocol=Zero-shot2024.05 | 40.8 | 19.3 | 13.5 |