Membership Inference Attack on TREC-COVID
0.893AUCMEntA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MEntALLM Generator=Phi4-14B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.893 | 86 | 70.9 | 74.4 | |
| DCMILLM Generator=Phi4-14B, RAG Setting=Fixed2026.05 | 0.886 | 88.6 | — | — | |
| MEntALLM Generator=CommandR-7B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.86 | 82 | 50.2 | 64.1 | |
| IALLM Generator=CommandR-7B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.857 | 78.7 | 0 | 46.1 | |
| IALLM Generator=Llama3.1-8B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.847 | 78.6 | 0 | 0 | |
| IALLM Generator=Phi4-14B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.816 | 75.2 | 0 | 42.6 | |
| MEntALLM Generator=Llama3.1-8B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.801 | 81.3 | 30.6 | 61.8 | |
| DCMILLM Generator=Llama3.1-8B, RAG Setting=Fixed2026.05 | 0.797 | 79.3 | — | — | |
| MBALLM Generator=Phi4-14B, RAG Setting=Fixed2026.05 | 0.781 | 76.8 | 53.6 | 57.5 | |
| DCMILLM Generator=CommandR-7B, RAG Setting=Fixed2026.05 | 0.772 | 76.9 | — | — | |
| MEntALLM Generator=Gemma2-2B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.757 | 73.2 | 33.2 | 47.2 | |
| MBALLM Generator=Llama3.1-8B, RAG Setting=Fixed2026.05 | 0.694 | 63.5 | 16.3 | 41.1 | |
| IALLM Generator=Gemma2-2B, Query Budget=5, RAG Setting=Fixed2026.05 | 0.675 | 64.8 | 0 | 10.2 | |
| MBALLM Generator=CommandR-7B, RAG Setting=Fixed2026.05 | 0.66 | 59.2 | 24.9 | 37.5 | |
| S2MIALLM Generator=Gemma2-2B, RAG Setting=Fixed2026.05 | 0.616 | 61.4 | 8.8 | 17.6 | |
| S2MIALLM Generator=Phi4-14B, RAG Setting=Fixed2026.05 | 0.604 | 59.4 | 10.2 | 17.4 | |
| DCMILLM Generator=Gemma2-2B, RAG Setting=Fixed2026.05 | 0.551 | 54.3 | — | — | |
| S2MIALLM Generator=Llama3.1-8B, RAG Setting=Fixed2026.05 | 0.541 | 53.4 | 4.7 | 7.8 | |
| S2MIALLM Generator=CommandR-7B, RAG Setting=Fixed2026.05 | 0.533 | 53.9 | 3.3 | 9.7 | |
| MBALLM Generator=Gemma2-2B, RAG Setting=Fixed2026.05 | 0.515 | 49.9 | 3.7 | 3.7 |