Membership Inference on WikiMIA
65CoverageN-GRAM COVERAGE ATTACK
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| N-GRAM COVERAGE ATTACKModel=LLaMa-65B2025.08 | 65 | 64 | 61 | 58 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-3.5-01252025.08 | 64 | 63 | 61 | 60 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-3.5-11062025.08 | 64 | 62 | 61 | 60 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=LLaMa-30B2025.08 | 63 | 62 | 57 | 58 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=GPT-3.5 Inst.2025.08 | 62 | 61 | 58 | 58 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=LLaMa-13B2025.08 | 62 | 59 | 57 | 54 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKModel=LLaMa-7B2025.08 | 60 | 59 | 56 | 55 | — | — | — | — | — | |
| DE-COPModel=GPT-3.5-01252025.08 | — | — | — | — | 55 | — | — | — | — | |
| DE-COPModel=GPT-3.5 Inst.2025.08 | — | — | — | — | 54 | — | — | — | — | |
| DE-COPModel=GPT-3.5-11062025.08 | — | — | — | — | 52 | — | — | — | — | |
| DE-COPModel=LLaMa-7B2025.08 | — | — | — | — | 48 | — | — | — | — | |
| DE-COPModel=LLaMa-13B2025.08 | — | — | — | — | 52 | — | — | — | — | |
| DE-COPModel=LLaMa-30B2025.08 | — | — | — | — | 49 | — | — | — | — | |
| DE-COPModel=LLaMa-65B2025.08 | — | — | — | — | 50 | — | — | — | — | |
| LossModel=LLaMa-7B2025.08 | — | — | — | — | — | 0.62 | — | — | — | |
| LossModel=LLaMa-13B2025.08 | — | — | — | — | — | 0.64 | — | — | — | |
| LossModel=LLaMa-30B2025.08 | — | — | — | — | — | 0.66 | — | — | — | |
| LossModel=LLaMa-65B2025.08 | — | — | — | — | — | 0.68 | — | — | — | |
| Min-K%Model=LLaMa-7B2025.08 | — | — | — | — | — | — | — | — | 64 | |
| Min-K%Model=LLaMa-13B2025.08 | — | — | — | — | — | — | — | — | 66 | |
| Min-K%Model=LLaMa-30B2025.08 | — | — | — | — | — | — | — | — | 69 | |
| Min-K%Model=LLaMa-65B2025.08 | — | — | — | — | — | — | — | — | 70 | |
| Reference LossModel=LLaMa-13B2025.08 | — | — | — | — | — | — | 0.63 | — | — | |
| Reference LossModel=LLaMa-30B2025.08 | — | — | — | — | — | — | 0.69 | — | — | |
| Reference LossModel=LLaMa-65B2025.08 | — | — | — | — | — | — | 0.74 | — | — | |
| zlibModel=LLaMa-7B2025.08 | — | — | — | — | — | — | — | 63 | — | |
| zlibModel=LLaMa-13B2025.08 | — | — | — | — | — | — | — | 65 | — | |
| zlibModel=LLaMa-30B2025.08 | — | — | — | — | — | — | — | 67 | — | |
| zlibModel=LLaMa-65B2025.08 | — | — | — | — | — | — | — | 69 | — |