Membership Inference Attack on LIBERO-Object
99.95AUCVLALeaks-MLP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VLALeaks-MLPTarget Model=OpenVLA-oft2026.06 | 99.95 | 99.21 | |
| VLALeaks-MLPTarget Model=OpenVLA2026.06 | 99.87 | 97.98 | |
| VLALeaks-RFTarget Model=OpenVLA-oft2026.06 | 99.5 | 91.06 | |
| VLALeaks-RFTarget Model=OpenVLA2026.06 | 99.4 | 87.58 | |
| SMITarget Model=OpenVLA-oft2026.06 | 97.74 | 60.2 | |
| RIMTarget Model=OpenVLA2026.06 | 92.22 | 42.1 | |
| RINMTarget Model=OpenVLA-oft2026.06 | 89.55 | 28.4 | |
| RINMTarget Model=OpenVLA2026.06 | 75.8 | 11.9 | |
| RIMTarget Model=OpenVLA-oft2026.06 | 71.59 | 7.8 | |
| SMITarget Model=OpenVLA2026.06 | 69.7 | 10.08 | |
| Min-kTarget Model=OpenVLA2026.06 | 60.84 | 3.52 | |
| MaxR-imgTarget Model=OpenVLA-oft2026.06 | 60.01 | 2.38 | |
| Min-k++Target Model=OpenVLA2026.06 | 56.07 | 2.68 | |
| MaxR-imgTarget Model=OpenVLA2026.06 | 49.84 | 2.76 | |
| LossTarget Model=OpenVLA-oft2026.06 | 49.79 | 1.22 | |
| MaxR-instTarget Model=OpenVLA2026.06 | 49.17 | 0.7 | |
| MaxR-despTarget Model=OpenVLA2026.06 | 48.37 | 0.82 | |
| LossTarget Model=OpenVLA2026.06 | 46.58 | 0.52 | |
| MaxR-instTarget Model=OpenVLA-oft2026.06 | 44.58 | 1.34 | |
| Min-kTarget Model=OpenVLA-oft2026.06 | 42.48 | 1.24 | |
| Min-k++Target Model=OpenVLA-oft2026.06 | 42.29 | 0.98 | |
| MaxR-despTarget Model=OpenVLA-oft2026.06 | 41.11 | 0.66 |