Text-to-Image Retrieval on Flickr30k (Robustness Metrics)
97.2R@1 (Clean)No Defense
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| No DefenseVLM=BLIP, l_infinity=2/2552025.12 | 97.2 | 25.1 | 63.26 | 50.19 | — | |
| No DefenseVLM=BLIP, l_infinity=4/2552025.12 | 97.2 | 61.18 | 86.39 | 71.27 | — | |
| FDAVLM=BLIP, l_infinity=2/2552025.12 | 96.5 | 7.66 | 18.96 | 40.98 | 51.6 | |
| FDAVLM=BLIP, l_infinity=4/2552025.12 | 96.5 | 15.86 | 28.37 | 60.64 | 56.36 | |
| No DefenseVLM=ALBEF, l_infinity=2/2552025.12 | 95.9 | 3.38 | 14.68 | 65.88 | — | |
| No DefenseVLM=ALBEF, l_infinity=4/2552025.12 | 95.9 | 8.72 | 16.09 | 80.92 | — | |
| FDAVLM=ALBEF, l_infinity=2/2552025.12 | 95.6 | 3.37 | 12.44 | 58.66 | 22.26 | |
| FDAVLM=ALBEF, l_infinity=4/2552025.12 | 95.6 | 7.9 | 13.7 | 75.8 | 14.69 | |
| No DefenseVLM=TCL, l_infinity=2/2552025.12 | 94.9 | 10.29 | 70.55 | 66.66 | — | |
| No DefenseVLM=TCL, l_infinity=4/2552025.12 | 94.9 | 37.66 | 81.11 | 81.63 | — | |
| FDAVLM=TCL, l_infinity=2/2552025.12 | 94.4 | 8.52 | 48.38 | 68.48 | 14.29 | |
| FDAVLM=TCL, l_infinity=4/2552025.12 | 94.4 | 30.36 | 58.64 | 86.24 | 13.55 | |
| TeCoAVLM=TCL, l_infinity=2/2552025.12 | 92.1 | 11.08 | 66.31 | 59.11 | 2.78 | |
| TeCoAVLM=TCL, l_infinity=4/2552025.12 | 92.1 | 44.29 | 80.62 | 80.08 | -4.16 | |
| FAREVLM=TCL, l_infinity=2/2552025.12 | 91.7 | 11.72 | 67.47 | 60.98 | 1.09 | |
| FAREVLM=TCL, l_infinity=4/2552025.12 | 91.7 | 46.21 | 81.03 | 79.64 | -6.42 | |
| TeCoAVLM=ALBEF, l_infinity=2/2552025.12 | 91.2 | 2.56 | 19.39 | 73.12 | -3.02 | |
| TeCoAVLM=ALBEF, l_infinity=4/2552025.12 | 91.2 | 9.13 | 19.34 | 85.48 | -2.15 | |
| FAREVLM=ALBEF, l_infinity=2/2552025.12 | 91.1 | 2.46 | 17.29 | 70.15 | 5.36 | |
| FAREVLM=ALBEF, l_infinity=4/2552025.12 | 91.1 | 9.27 | 18.6 | 86.25 | -2.48 | |
| TeCoAVLM=BLIP, l_infinity=2/2552025.12 | 90.3 | 19.28 | 59.38 | 48.67 | 15.7 | |
| TeCoAVLM=BLIP, l_infinity=4/2552025.12 | 90.3 | 62.39 | 88.85 | 75.69 | -1.09 | |
| FAREVLM=BLIP, l_infinity=2/2552025.12 | 89.7 | 20.24 | 66.53 | 54.92 | 3.09 | |
| FAREVLM=BLIP, l_infinity=4/2552025.12 | 89.7 | 66.29 | 92.35 | 80.49 | -7.04 |