Sample-level Membership Inference on LIBERO Object
1AUCAgg.-NLL
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Agg.-NLLModel=π0-fast2026.05 | 1 | 100 | 100 | 100 | |
| Agg.-NLLModel=OpenVLA2026.05 | 1 | 100 | 100 | 100 | |
| Agg.-ConfModel=OpenVLA2026.05 | 1 | 100 | 100 | 100 | |
| Temp.-SmoothModel=OpenVLA2026.05 | 1 | 100 | 100 | 100 | |
| Temp.-CurveModel=OpenVLA2026.05 | 1 | 100 | 100 | 100 | |
| Action-L1Model=OpenVLA2026.05 | 1 | 100 | 100 | 100 | |
| Action-MSEModel=OpenVLA2026.05 | 1 | 100 | 100 | 100 | |
| NLLModel=π0-fast2026.05 | 0.9996 | 93.92 | 99.9 | 100 | |
| Action-L1Model=π0-fast2026.05 | 0.9903 | 99 | 99 | 99 | |
| Action-MSEModel=π0-fast2026.05 | 0.9902 | 99 | 99 | 99 | |
| Action-L1Model=π0-fast2026.05 | 0.9747 | 19.25 | 59.48 | 91.63 | |
| Action-MSEModel=π0-fast2026.05 | 0.9672 | 18.93 | 62.28 | 91.46 | |
| Agg.-ConfModel=π0-fast2026.05 | 0.9533 | 74 | 77 | 86 | |
| Action-L1Setting=Sample2026.05 | 0.9258 | 2.36 | 23.01 | 56.71 | |
| Action-MSEModel=OpenVLA2026.05 | 0.9064 | 56.79 | 67.92 | 76.99 | |
| Action-L1Model=OpenVLA2026.05 | 0.9058 | 56.87 | 66.87 | 75.62 | |
| Action-MSESetting=Sample2026.05 | 0.9025 | 5.06 | 24.55 | 60.46 | |
| NLLModel=OpenVLA2026.05 | 0.8906 | 14.4 | 31.65 | 55.5 | |
| Flow-LossSetting=Sample2026.05 | 0.89 | 3.71 | 20.88 | 46.84 | |
| ConfModel=OpenVLA2026.05 | 0.8086 | 3.8 | 15.96 | 35.34 | |
| Temp.-CurveModel=π0-fast2026.05 | 0.7729 | 14 | 15 | 31 | |
| Agg.-Conf-FixModel=π0-fast2026.05 | 0.7226 | 28 | 31 | 44 | |
| ConfModel=π0-fast2026.05 | 0.6817 | 1.66 | 10.91 | 21.93 | |
| Temp.-SmoothModel=π0-fast2026.05 | 0.6116 | 0 | 1 | 8 | |
| Conf-FixPromptModel=π0-fast2026.05 | 0.5717 | 0.54 | 3.11 | 10.12 | |
| Agg.-Conf-FixModel=OpenVLA2026.05 | 0.5699 | 2 | 2 | 11 | |
| Conf-FixPromptModel=OpenVLA2026.05 | 0.5037 | 0.06 | 0.9 | 5.24 | |
| Flow-Loss-FixPromptSetting=Sample2026.05 | 0.4936 | 0.11 | 1 | 4.56 |