WikiMIA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WikiMIA Hard Original 2024 v1 (test)
60.6AUROC
7
WikiMIA Factoid QA
0.967AUC
6
WikiMIA Summarization
0.964AUC
6
WikiMIA Continuation
96.9AUC
6
WikiMIA full
95.7AUC
3
WikiMIA CoT within-dataset references
0.957CRM-LR AUC
3
WikiMIA Paraphrased Length 128
73.3AUROC
2
WikiMIA Original Length 128
75.9AUROC
2
WikiMIA Paraphrased Length 64
0.706AUROC
2
WikiMIA Original Length 64
74.8AUROC
2
WikiMIA Paraphrased Length 32
70.9AUROC
2