Pre-training Data Detection on WikiMIA Original Length 32
85.9AUROCMin-k%++
Evaluation results
| Method | Links | |
|---|---|---|
| Min-k%++Backbone=LLaMA-13B, LPDR Enhancement=true2026.01 | 85.9 | |
| Min-k%++Backbone=LLaMA-13B, LPDR Enhancement=false2026.01 | 84.4 | |
| Min-k%++Backbone=GPT-NeoX-20B, LPDR Enhancement=true2026.01 | 75.2 | |
| Min-k%++Backbone=GPT-NeoX-20B, LPDR Enhancement=false2026.01 | 75.1 | |
| Min-k%++Backbone=Average, LPDR Enhancement=true2026.01 | 73.9 | |
| Min-k%++Backbone=Average, LPDR Enhancement=false2026.01 | 73.2 | |
| Min-k%++Backbone=Pythia-6.9B, LPDR Enhancement=true2026.01 | 70.8 | |
| Min-k%++Backbone=Pythia-6.9B, LPDR Enhancement=false2026.01 | 70.3 | |
| Min-k%++Backbone=OPT-66B, LPDR Enhancement=true2026.01 | 70.2 | |
| Min-k%++Backbone=OPT-66B, LPDR Enhancement=false2026.01 | 69.7 | |
| Min-k%++Backbone=Mamba-1.4B, LPDR Enhancement=true2026.01 | 67.4 | |
| Min-k%++Backbone=Mamba-1.4B, LPDR Enhancement=false2026.01 | 66.4 | |
| NeighborBackbone=Mamba-1.4B, LPDR Enhancement=false2026.01 | 64.1 | |
| Min-k%Backbone=Mamba-1.4B, LPDR Enhancement=true2026.01 | 63.5 | |
| Min-k%Backbone=Mamba-1.4B, LPDR Enhancement=false2026.01 | 63.3 | |
| RefBackbone=Mamba-1.4B, LPDR Enhancement=false2026.01 | 62.2 | |
| RefBackbone=Mamba-1.4B, LPDR Enhancement=true2026.01 | 62.2 | |
| ZlibBackbone=Mamba-1.4B, LPDR Enhancement=false2026.01 | 61.9 | |
| LossBackbone=Mamba-1.4B, LPDR Enhancement=true2026.01 | 61.5 | |
| LossBackbone=Mamba-1.4B, LPDR Enhancement=false2026.01 | 61 | |
| LowercaseBackbone=Mamba-1.4B, LPDR Enhancement=false2026.01 | 60.9 |