WikiMIA
Benchmarks
TaskDatasetSOTA resultTrendResults
WikiMIA length 64
0.956AUC
84
WikiMIA K = 16
0.643Attack Power
72
WikiMIA 32 tokens 1.0
99.7ROC AUC
66
WikiMIA length 128
98.84AUC
56
WikiMIA length 32
0.596TPR @ 5% FPR
54
WikiMIA length 128 (test)
96.72TPR @ 5% FPR
49
WikiMIA length 64 (test)
73.77TPR@5%FPR
49
WikiMIA source-attribution
0.951AUC
30
WikiMIA (test)
96AUROC
30
WikiMIA length 128
0.874AUC
28
WikiMIA length 256
0.8AUC (MIA)
24
WikiMIA
71AUC
24
WikiMIA
74.3AUC
23
WikiMIA (test)
1AUC
21
WikiMIA Original Length 32
85.9AUROC
21
WikiMIA
19.6TPR@5%FPR
16
WikiMIA alpha=0.3 1.0 (test)
2.9Perplexity
15
WikiMIA alpha=0.2 1.0 (test)
1.04Power (Perplexity)
15
WikiMIA alpha=0.1 1.0 (test)
0.21Power Perplexity
15
WikiMIA 128 tokens 1.0
94.8ROC AUC
11
WikiMIA 64 tokens 1.0
97.9ROC AUC
11
WikiMIA Hard 2024
0.64Coverage
10
WikiMIA 24
0.84Covariance (Cov.)
10
WikiMIA
65Coverage
7
WikiMIA Hard (Paraphrased) 2024 v1 (test)
58.4AUROC
7