Membership Inference on WikiMIA 24
0.84Covariance (Cov.)N-GRAM COVERAGE ATTACK
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| N-GRAM COVERAGE ATTACKModel=GPT-42025.08 | 0.84 | 0.82 | 0.76 | 0.79 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-4o-11202025.08 | 0.83 | 0.82 | 0.77 | 0.79 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-4o Mini2025.08 | 0.73 | 0.74 | 0.66 | 0.69 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-3.5-11062025.08 | 0.68 | 0.67 | 0.66 | 0.68 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-3.5-01252025.08 | 0.67 | 0.67 | 0.64 | 0.66 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=LLaMA-30B2025.08 | 0.67 | 0.66 | 0.64 | 0.64 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-3.5 Inst.2025.08 | 0.65 | 0.64 | 0.62 | 0.64 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=LLaMA-65B2025.08 | 0.64 | 0.65 | 0.65 | 0.65 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=LLaMA-13B2025.08 | 0.63 | 0.63 | 0.61 | 0.61 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=LLaMA-7B2025.08 | 0.59 | 0.59 | 0.6 | 0.59 | — | — | — | — | — | |
| DE-COPModel=GPT-3.5-01252025.08 | — | — | — | — | 0.48 | — | — | — | — | |
| DE-COPModel=GPT-3.5 Inst.2025.08 | — | — | — | — | 0.5 | — | — | — | — | |
| DE-COPModel=GPT-3.5-11062025.08 | — | — | — | — | 0.49 | — | — | — | — | |
| DE-COPModel=GPT-42025.08 | — | — | — | — | 0.56 | — | — | — | — | |
| DE-COPModel=GPT-4o-11202025.08 | — | — | — | — | 0.5 | — | — | — | — | |
| DE-COPModel=GPT-4o Mini2025.08 | — | — | — | — | 0.44 | — | — | — | — | |
| DE-COPModel=LLaMA-7B2025.08 | — | — | — | — | 0.53 | — | — | — | — | |
| DE-COPModel=LLaMA-13B2025.08 | — | — | — | — | 0.5 | — | — | — | — | |
| DE-COPModel=LLaMA-30B2025.08 | — | — | — | — | 0.48 | — | — | — | — | |
| DE-COPModel=LLaMA-65B2025.08 | — | — | — | — | 0.5 | — | — | — | — | |
| LossModel=LLaMA-7B2025.08 | — | — | — | — | — | 0.67 | — | — | — | |
| LossModel=LLaMA-13B2025.08 | — | — | — | — | — | 0.68 | — | — | — | |
| LossModel=LLaMA-30B2025.08 | — | — | — | — | — | 0.72 | — | — | — | |
| LossModel=LLaMA-65B2025.08 | — | — | — | — | — | 0.74 | — | — | — | |
| Min-K%Model=LLaMA-7B2025.08 | — | — | — | — | — | — | — | — | 0.69 | |
| Min-K%Model=LLaMA-13B2025.08 | — | — | — | — | — | — | — | — | 0.71 | |
| Min-K%Model=LLaMA-30B2025.08 | — | — | — | — | — | — | — | — | 0.74 | |
| Min-K%Model=LLaMA-65B2025.08 | — | — | — | — | — | — | — | — | 0.76 | |
| Reference LossModel=LLaMA-13B2025.08 | — | — | — | — | — | — | 0.6 | — | — | |
| Reference LossModel=LLaMA-30B2025.08 | — | — | — | — | — | — | 0.69 | — | — | |
| Reference LossModel=LLaMA-65B2025.08 | — | — | — | — | — | — | 0.74 | — | — | |
| zlibModel=LLaMA-7B2025.08 | — | — | — | — | — | — | — | 0.67 | — | |
| zlibModel=LLaMA-13B2025.08 | — | — | — | — | — | — | — | 0.69 | — | |
| zlibModel=LLaMA-30B2025.08 | — | — | — | — | — | — | — | 0.72 | — | |
| zlibModel=LLaMA-65B2025.08 | — | — | — | — | — | — | — | 0.75 | — |