Image-Text Retrieval on WIT Well-resourced v1 (test)
82.4Retrieval Score (en)MURAL-LARGE
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MURAL-LARGEEvaluation Protocol=Fine-tuned2021.09 | 82.4 | 76.3 | 83.3 | 74.5 | 71.9 | 86.7 | 77.4 | 77.4 | 85.7 | |
| MURAL-BASEEvaluation Protocol=Fine-tuned2021.09 | 77.1 | 70 | 77.2 | 68.4 | 64.8 | 79.6 | 70.8 | 70.7 | 78.2 | |
| ALIGN-BASEEvaluation Protocol=Fine-tuned2021.09 | 75.6 | 69.2 | 76.2 | 65.5 | 64.4 | 78.2 | 68.3 | 68.3 | 75 | |
| ALIGN-BASE-ENEvaluation Protocol=Fine-tuned2021.09 | 66.4 | 48.8 | 58.5 | 44.7 | 40.2 | 48.2 | 55.2 | 52 | 58 | |
| MURAL-LARGEEvaluation Protocol=Zero-shot2021.09 | 60.7 | 46.1 | 60 | 43.6 | 48.1 | 49.9 | 45.7 | 45.8 | 49.8 | |
| ALIGN-BASEEvaluation Protocol=Zero-shot2021.09 | 46.7 | 33.5 | 45 | 26.5 | 33.6 | 35.2 | 30.9 | 29.9 | 31.4 | |
| ALIGN-BASE-ENEvaluation Protocol=Zero-shot2021.09 | 46.5 | 33.9 | 42.3 | 32.4 | 29.9 | 36.2 | 40.1 | 39.2 | 40.5 | |
| MURAL-BASEEvaluation Protocol=Zero-shot2021.09 | 46.4 | 33.9 | 44.8 | 31.5 | 34.3 | 35.6 | 33.7 | 33.2 | 34.7 |