Membership Inference Attack on VL-MIA TEXT (TEXTLEN=32)
78.2AccuracyAutoMIA (Agent)
Evaluation Results
| Method | Links | |
|---|---|---|
| AutoMIA (Agent)Target Model=LLaMAAdapter, Reasoner=DEEPSEEK-V3.2-REASONER2026.04 | 78.2 | |
| AutoMIA (Agent)Target Model=MiniGPT-4, Reasoner=DEEPSEEK-V3.2-REASONER2026.04 | 76.2 | |
| MoDRényiTarget Model=LLaVA, alpha=12026.04 | 73.7 | |
| AutoMIA (Agent)Target Model=LLaVA, Reasoner=DEEPSEEK-V3.2-REASONER2026.04 | 73.7 | |
| MoDRényiTarget Model=LLaVA, alpha=0.52026.04 | 73.5 | |
| PerplexityTarget Model=LLaMAAdapter2026.04 | 72.7 | |
| MoDRényiTarget Model=LLaMAAdapter, alpha=12026.04 | 72.3 | |
| PerplexityTarget Model=LLaVA2026.04 | 71.7 | |
| MoDRényiTarget Model=LLaVA, alpha=22026.04 | 71.5 | |
| Min-k ProbTarget Model=LLaMAAdapter, k=20%2026.04 | 67.2 | |
| PerplexityTarget Model=MiniGPT-42026.04 | 67 | |
| MoDRényiTarget Model=MiniGPT-4, alpha=12026.04 | 66.3 | |
| MoDRényiTarget Model=LLaMAAdapter, alpha=0.52026.04 | 66 | |
| RényiTarget Model=LLaMAAdapter, alpha=1, Max-prob-k=100%2026.04 | 63.3 | |
| Max Prob GapTarget Model=MiniGPT-42026.04 | 62.7 | |
| Min-k ProbTarget Model=LLaMAAdapter, k=10%2026.04 | 62.7 | |
| MoDRényiTarget Model=LLaMAAdapter, alpha=22026.04 | 61.7 | |
| Min-k ProbTarget Model=LLaMAAdapter, k=0%2026.04 | 61.3 | |
| RényiTarget Model=LLaMAAdapter, alpha=0.5, Max-prob-k=0%2026.04 | 61.2 | |
| Min-k ProbTarget Model=MiniGPT-4, k=20%2026.04 | 59.8 | |
| MoDRényiTarget Model=MiniGPT-4, alpha=0.52026.04 | 59.7 | |
| RényiTarget Model=MiniGPT-4, alpha=1, Max-prob-k=100%2026.04 | 59.5 | |
| Max Prob GapTarget Model=LLaMAAdapter2026.04 | 58.8 | |
| Min-k ProbTarget Model=LLaVA, k=20%2026.04 | 58 | |
| Min-k ProbTarget Model=MiniGPT-4, k=10%2026.04 | 57.5 | |
| Min-k ProbTarget Model=MiniGPT-4, k=0%2026.04 | 57.2 | |
| MoDRényiTarget Model=MiniGPT-4, alpha=22026.04 | 56.8 | |
| RényiTarget Model=MiniGPT-4, alpha=0.5, Max-prob-k=0%2026.04 | 55 | |
| RényiTarget Model=LLaVA, alpha=1, Max-prob-k=100%2026.04 | 54.8 | |
| Min-k ProbTarget Model=LLaVA, k=0%2026.04 | 52.2 | |
| Max Prob GapTarget Model=LLaVA2026.04 | 51.3 | |
| RényiTarget Model=LLaVA, alpha=0.5, Max-prob-k=0%2026.04 | 51.3 | |
| Min-k ProbTarget Model=LLaVA, k=10%2026.04 | 50.7 |