Image-to-text Retrieval on ROCO (test)
37.5Retrieval AccuracyDP-GCL
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DP-GCLepsilon=102026.04 | 37.5 | — | — | — | |
| DP-GCLepsilon=12026.04 | 23.2 | — | — | — | |
| Baseepsilon=12026.04 | 20.5 | — | — | — | |
| Baseepsilon=102026.04 | 20.5 | — | — | — | |
| DP-SGDepsilon=102026.04 | 20.4 | — | — | — | |
| Logit-DPepsilon=102026.04 | 19.7 | — | — | — | |
| DP-CLIPepsilon=102026.04 | 19.4 | — | — | — | |
| DP-SGDepsilon=12026.04 | 18.7 | — | — | — | |
| Logit-DPepsilon=12026.04 | 18.7 | — | — | — | |
| DP-CLIPepsilon=12026.04 | 18.4 | — | — | — | |
| ARLEvaluation Protocol=Zero-shot, Pretrain Data=ROCO, MedICaT, CXR, DataSize=233 K2023.03 | — | 23.45 | 50.6 | 62.05 | |
| M3AEEvaluation Protocol=zero-shot (ZS)2022.09 | — | 19.1 | 45.6 | 61.2 | |
| M3AEEvaluation Protocol=fine-tuning (FT)2022.09 | — | 22.9 | 51.05 | 65.8 | |
| M3AEEvaluation Protocol=Zero-shot, Pretrain Data=ROCO, MedICaT, DataSize=233 K2023.03 | — | 19.1 | 45.6 | 61.2 | |
| METER2022.09 | — | 14.45 | 33.3 | 45.1 | |
| METEREvaluation Protocol=Zero-shot, Pretrain Data=COCO, VG, SBU, GCC, DataSize=4.1M2023.03 | — | 14.45 | 33.3 | 45.1 | |
| PMC-CLIPEvaluation Protocol=Zero-shot, Pretrain Data=PMC-OA, DataSize=1.6 M2023.03 | — | 31.41 | 61.15 | 71.88 | |
| ViLT2022.09 | — | 11.9 | 31.9 | 43.2 | |
| ViLTEvaluation Protocol=Zero-shot, Pretrain Data=COCO, VG, SBU, GCC, DataSize=4.1M2023.03 | — | 11.9 | 31.9 | 43.2 |