Text-to-image retrieval on ROCO (test)
38.4Retrieval AccuracyDP-GCL
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DP-GCLepsilon=102026.04 | 38.4 | — | — | — | |
| DP-GCLepsilon=12026.04 | 25.3 | — | — | — | |
| DP-CLIPepsilon=102026.04 | 20.5 | — | — | — | |
| Baseepsilon=12026.04 | 20.2 | — | — | — | |
| Baseepsilon=102026.04 | 20.2 | — | — | — | |
| Logit-DPepsilon=102026.04 | 19.5 | — | — | — | |
| DP-SGDepsilon=102026.04 | 18.8 | — | — | — | |
| Logit-DPepsilon=12026.04 | 18.2 | — | — | — | |
| DP-CLIPepsilon=12026.04 | 18 | — | — | — | |
| DP-SGDepsilon=12026.04 | 17.9 | — | — | — | |
| ARLEvaluation Protocol=Zero-shot, Pretrain Data=ROCO, MedICaT, CXR, DataSize=233 K2023.03 | — | 23.5 | 49.05 | 63 | |
| M3AEEvaluation Protocol=zero-shot (ZS)2022.09 | — | 0.1905 | 0.4775 | 0.6135 | |
| M3AEEvaluation Protocol=fine-tuning (FT)2022.09 | — | 0.222 | 0.525 | 0.6665 | |
| M3AEEvaluation Protocol=Zero-shot, Pretrain Data=ROCO, MedICaT, DataSize=233 K2023.03 | — | 19.05 | 47.75 | 61.35 | |
| METER2022.09 | — | 0.113 | 0.2725 | 0.396 | |
| METEREvaluation Protocol=Zero-shot, Pretrain Data=COCO, VG, SBU, GCC, DataSize=4.1M2023.03 | — | 11.3 | 27.25 | 39.6 | |
| PMC-CLIPEvaluation Protocol=Zero-shot, Pretrain Data=PMC-OA, DataSize=1.6 M2023.03 | — | 28.02 | 58.33 | 69.69 | |
| ViLT2022.09 | — | 0.0975 | 0.2895 | 0.414 | |
| ViLTEvaluation Protocol=Zero-shot, Pretrain Data=COCO, VG, SBU, GCC, DataSize=4.1M2023.03 | — | 9.75 | 28.95 | 41.4 |