Image-to-Text Retrieval on COCO (Robustness Metrics)
60.7R@1 (Clean)No Defense
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| No DefenseVLM=ALBEF, l_infinity=2/2552025.12 | 60.7 | 0.35 | 8.86 | 19.4 | — | |
| No DefenseVLM=ALBEF, l_infinity=4/2552025.12 | 60.7 | 2.41 | 12.18 | 36.17 | — | |
| FDAVLM=ALBEF, l_infinity=2/2552025.12 | 60.63 | 0.28 | 8.03 | 18.02 | 9.28 | |
| FDAVLM=ALBEF, l_infinity=4/2552025.12 | 60.63 | 2.05 | 10.57 | 32.83 | 14.43 | |
| FAREVLM=ALBEF, l_infinity=2/2552025.12 | 53.58 | 0.02 | 14.59 | 16.76 | 0.53 | |
| FAREVLM=ALBEF, l_infinity=4/2552025.12 | 53.58 | 0.35 | 24.35 | 39.61 | -16.08 | |
| TeCoAVLM=ALBEF, l_infinity=2/2552025.12 | 53.07 | 0.15 | 13.05 | 18.89 | 2.87 | |
| TeCoAVLM=ALBEF, l_infinity=4/2552025.12 | 53.07 | 0.36 | 20.57 | 40.37 | -3.25 |