Membership Inference Attack on VL-MIA TEXT (TEXTLEN=64)
96.3AccuracyAutoMIA (Agent)
Evaluation results
| Method | Links | |
|---|---|---|
| AutoMIA (Agent)Target Model=LLaVA, Reasoner=DEEPSEEK-V3.2-REASONER2026.04 | 96.3 | |
| MoDRényiTarget Model=LLaVA, alpha=12026.04 | 96.2 | |
| PerplexityTarget Model=LLaVA2026.04 | 94.3 | |
| Min-k ProbTarget Model=LLaVA, k=10%2026.04 | 80.8 | |
| RényiTarget Model=MiniGPT-4, alpha=0.5, Max-prob-k=100%2026.04 | 80 | |
| AutoMIA (Agent)Target Model=MiniGPT-4, Reasoner=DEEPSEEK-V3.2-REASONER2026.04 | 79.7 | |
| PerplexityTarget Model=MiniGPT-42026.04 | 75.8 | |
| RényiTarget Model=LLaVA, alpha=0.5, Max-prob-k=100%2026.04 | 75.8 | |
| MoDRényiTarget Model=MiniGPT-4, alpha=12026.04 | 75.5 | |
| AutoMIA (Agent)Target Model=LLaMAAdapter, Reasoner=DEEPSEEK-V3.2-REASONER2026.04 | 72.2 | |
| Min-k ProbTarget Model=MiniGPT-4, k=10%2026.04 | 64.2 | |
| Max Prob GapTarget Model=LLaMAAdapter2026.04 | 60 | |
| Max Prob GapTarget Model=LLaVA2026.04 | 55.5 | |
| PerplexityTarget Model=LLaMAAdapter2026.04 | 51.2 | |
| Max Prob GapTarget Model=MiniGPT-42026.04 | 51.2 | |
| MoDRényiTarget Model=LLaMAAdapter, alpha=12026.04 | 51.2 | |
| Min-k ProbTarget Model=LLaMAAdapter, k=10%2026.04 | 50.2 | |
| RényiTarget Model=LLaMAAdapter, alpha=0.5, Max-prob-k=100%2026.04 | 50 |