Membership Inference Attack on LIBERO Goal
99.76AUCVLALeaks-MLP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VLALeaks-MLPTarget Model=OpenVLA-oft2026.06 | 99.76 | 94.93 | |
| VLALeaks-RFTarget Model=OpenVLA-oft2026.06 | 98.96 | 80.99 | |
| SMITarget Model=OpenVLA-oft2026.06 | 97.04 | 60.24 | |
| VLALeaks-RFTarget Model=OpenVLA2026.06 | 95.08 | 44.3 | |
| VLALeaks-MLPTarget Model=OpenVLA2026.06 | 93 | 34.06 | |
| RIMTarget Model=OpenVLA2026.06 | 87.16 | 27.4 | |
| MaxR-imgTarget Model=OpenVLA2026.06 | 81.55 | 14.09 | |
| RINMTarget Model=OpenVLA2026.06 | 76.29 | 10.7 | |
| RIMTarget Model=OpenVLA-oft2026.06 | 66.24 | 2.7 | |
| Min-k++Target Model=OpenVLA2026.06 | 61.81 | 2.12 | |
| RINMTarget Model=OpenVLA-oft2026.06 | 60.94 | 2.2 | |
| MaxR-instTarget Model=OpenVLA2026.06 | 60.15 | 5.02 | |
| SMITarget Model=OpenVLA2026.06 | 55.01 | 14.1 | |
| LossTarget Model=OpenVLA-oft2026.06 | 53.69 | 1.14 | |
| Min-kTarget Model=OpenVLA2026.06 | 53.19 | 4.52 | |
| Min-k++Target Model=OpenVLA-oft2026.06 | 52.95 | 1.74 | |
| MaxR-despTarget Model=OpenVLA2026.06 | 48.21 | 0.93 | |
| MaxR-despTarget Model=OpenVLA-oft2026.06 | 46.9 | 0.9 | |
| MaxR-instTarget Model=OpenVLA-oft2026.06 | 46.26 | 0.38 | |
| MaxR-imgTarget Model=OpenVLA-oft2026.06 | 46.23 | 0.48 | |
| LossTarget Model=OpenVLA2026.06 | 45.75 | 0.16 | |
| Min-kTarget Model=OpenVLA-oft2026.06 | 45.22 | 1.04 |