Membership Inference on MIA-Bench 5% Forget Set
69.6Average PerformanceVanilla
Evaluation Results
| Method | Links | |
|---|---|---|
| VanillaBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 69.6 | |
| MANUBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 64.02 | |
| NPOBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 63.44 | |
| KL Minim.Base Model=LLaVA, Forget Set Ratio=5%2025.02 | 62.24 | |
| Grad. DiffBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 59.02 | |
| GABase Model=LLaVA, Forget Set Ratio=5%2025.02 | 57.29 | |
| VanillaBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 54.42 | |
| MANUBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 51.33 | |
| NPOBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 50.89 | |
| KL Minim.Base Model=Idefics2, Forget Set Ratio=5%2025.02 | 49.64 | |
| Grad. DiffBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 48.58 | |
| GABase Model=Idefics2, Forget Set Ratio=5%2025.02 | 47.77 |