Membership Inference on CLIP image-text (train)
91.68PrecisionUMID
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| UMIDSetting=ResNet-50 (many-shot), Real data=1 img2026.03 | 91.68 | 99.25 | 95.54 | 0.752 | |
| UMIDSetting=ResNet-50x4 (many-shot), Real data=1 img2026.03 | 91.56 | 99.08 | 95.62 | 0.691 | |
| UMIDSetting=ResNet-50 (one-shot), Real data=1 img2026.03 | 91.45 | 99.12 | 95.28 | 0.745 | |
| UMIDSetting=ResNet-50x4 (one-shot), Real data=1 img2026.03 | 91.28 | 98.96 | 95.35 | 0.685 | |
| UMIDSetting=ResNet-50x4 (many-shot), Real data=Null2026.03 | 87.12 | 99.16 | 94.62 | 0.637 | |
| UMIDSetting=ResNet-50 (many-shot), Real data=Null2026.03 | 86.42 | 98.35 | 90.31 | 0.634 | |
| UMIDSetting=ResNet-50 (one-shot), Real data=Null2026.03 | 86.34 | 98.21 | 91.72 | 0.628 | |
| UMIDSetting=ResNet-50x4 (one-shot), Real data=Null2026.03 | 86.13 | 97.47 | 93.55 | 0.633 | |
| MIASetting=ResNet-50x4 (one-shot), Real data=1 img2026.03 | 79.37 | 64.92 | 72.18 | 4.37 | |
| MIASetting=ResNet-50x4 (many-shot), Real data=1 img2026.03 | 76.54 | 69.81 | 71.89 | 4.36 | |
| MIASetting=ResNet-50 (many-shot), Real data=1 img2026.03 | 75.3 | 70.86 | 72.19 | 4.32 | |
| UMIDSetting=ViT-B/32 (many-shot), Real data=1 img2026.03 | 74.98 | 68.44 | 71.86 | 0.712 | |
| UMIDSetting=ViT-B/32 (one-shot), Real data=1 img2026.03 | 74.62 | 68.15 | 71.45 | 0.701 | |
| C-WSASetting=ResNet-50x4 (many-shot), Real data=1 img2026.03 | 73.64 | 46.7 | 73.21 | 2,150.3 | |
| C-WSASetting=ResNet-50x4 (one-shot), Real data=1 img2026.03 | 73.05 | 45.92 | 72.34 | 2,148.6 | |
| MIASetting=ResNet-50 (one-shot), Real data=1 img2026.03 | 72.51 | 68.73 | 70.42 | 4.32 | |
| C-WSASetting=ResNet-50 (many-shot), Real data=1 img2026.03 | 72.45 | 46.05 | 72.18 | 2,149.5 | |
| C-WSASetting=ResNet-50 (one-shot), Real data=1 img2026.03 | 72.1 | 45.3 | 71.25 | 2,141.4 | |
| UMIDSetting=ViT-B/32 (many-shot), Real data=Null2026.03 | 71.82 | 63.72 | 69.47 | 0.652 | |
| UMIDSetting=ViT-B/32 (one-shot), Real data=Null2026.03 | 70.91 | 63.85 | 68.37 | 0.667 | |
| IDIASetting=ResNet-50x4 (many-shot), Real data=3 imgs2026.03 | 70.85 | 39.04 | 71.67 | 0.844 | |
| WSASetting=ViT-B/32 (many-shot), Real data=1 img2026.03 | 70.45 | 28.06 | 68.95 | 2,144.8 | |
| C-WSASetting=ViT-B/32 (many-shot), Real data=1 img2026.03 | 70.12 | 43.05 | 70.08 | 2,147.9 | |
| MIASetting=ViT-B/32 (many-shot), Real data=1 img2026.03 | 69.58 | 63.41 | 67.32 | 4.35 | |
| C-WSASetting=ViT-B/32 (one-shot), Real data=1 img2026.03 | 69.45 | 42.3 | 69.12 | 2,146.2 | |
| MIASetting=ViT-B/32 (one-shot), Real data=1 img2026.03 | 69.23 | 59.87 | 66.94 | 4.35 | |
| IDIASetting=ResNet-50 (one-shot), Real data=3 imgs2026.03 | 69.22 | 40.31 | 68.36 | 0.845 | |
| IDIASetting=ResNet-50 (many-shot), Real data=3 imgs2026.03 | 69.01 | 39.98 | 69.07 | 0.851 | |
| IDIASetting=ViT-B/32 (many-shot), Real data=3 imgs2026.03 | 68.9 | 38.11 | 69.27 | 1.251 | |
| IDIASetting=ViT-B/32 (one-shot), Real data=3 imgs2026.03 | 67.83 | 37.46 | 67.72 | 1.245 | |
| WSASetting=ResNet-50x4 (many-shot), Real data=1 img2026.03 | 67.24 | 29.35 | 66.85 | 2,156.7 | |
| WSASetting=ResNet-50x4 (one-shot), Real data=1 img2026.03 | 67.12 | 29.12 | 68.08 | 2,144.3 | |
| WSASetting=ResNet-50 (one-shot), Real data=1 img2026.03 | 66.53 | 29.25 | 66.75 | 2,158.1 | |
| WSASetting=ResNet-50 (many-shot), Real data=1 img2026.03 | 66.25 | 28.67 | 67.1 | 2,143.7 | |
| IDIASetting=ResNet-50x4 (one-shot), Real data=3 imgs2026.03 | 66.25 | 39.8 | 69.57 | 0.851 | |
| WSASetting=ViT-B/32 (one-shot), Real data=1 img2026.03 | 63.23 | 29.64 | 68.12 | 2,143.1 |