Membership Inference Attack on NFCorpus
0.989AUCMEntA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MEntALLM Generator=Phi4-14B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.989 | 96 | 78.4 | 94.7 | |
| MEntALLM Generator=CommandR-7B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.973 | 92.8 | 42.2 | 84.8 | |
| MEntALLM Generator=Llama3.1-8B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.935 | 89.8 | 36.3 | 60.4 | |
| MBALLM Generator=Phi4-14B, RAG Setting=Fixed2026.05 | 0.874 | 85.9 | 64.4 | 75.5 | |
| MEntALLM Generator=Gemma2-2B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.836 | 79 | 33.8 | 45.2 | |
| DCMILLM Generator=Phi4-14B, RAG Setting=Fixed2026.05 | 0.828 | 82.8 | — | — | |
| MBALLM Generator=Llama3.1-8B, RAG Setting=Fixed2026.05 | 0.827 | 69.8 | 25.3 | 42.1 | |
| DCMILLM Generator=Llama3.1-8B, RAG Setting=Fixed2026.05 | 0.822 | 81.9 | — | — | |
| IALLM Generator=Llama3.1-8B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.808 | 74.1 | 0 | 21.8 | |
| DCMILLM Generator=CommandR-7B, RAG Setting=Fixed2026.05 | 0.789 | 78.8 | — | — | |
| IALLM Generator=CommandR-7B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.778 | 72 | 0 | 21.1 | |
| IALLM Generator=Phi4-14B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.756 | 71.2 | 0 | 18.5 | |
| S2MIALLM Generator=Phi4-14B, RAG Setting=Fixed2026.05 | 0.711 | 66.4 | 19.2 | 31.5 | |
| MBALLM Generator=CommandR-7B, RAG Setting=Fixed2026.05 | 0.708 | 61.6 | 30.2 | 44 | |
| S2MIALLM Generator=Gemma2-2B, RAG Setting=Fixed2026.05 | 0.674 | 63.3 | 7.3 | 23.5 | |
| IALLM Generator=Gemma2-2B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.627 | 60.5 | 0 | 4.1 | |
| DCMILLM Generator=Gemma2-2B, RAG Setting=Fixed2026.05 | 0.555 | 54.8 | — | — | |
| MBALLM Generator=Gemma2-2B, RAG Setting=Fixed2026.05 | 0.522 | 50 | 1.7 | 6.5 | |
| S2MIALLM Generator=Llama3.1-8B, RAG Setting=Fixed2026.05 | 0.515 | 52.9 | 4.8 | 10.8 | |
| S2MIALLM Generator=CommandR-7B, RAG Setting=Fixed2026.05 | 0.489 | 52.2 | 3.4 | 8.7 |