Pre-training data detection on BookMIA (test)
0.99AUROCGDS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GDSTarget Model=Neo-2.7B2026.03 | 0.99 | 98 | |
| GDSTarget Model=GPT-J-6b2026.03 | 0.99 | 99 | |
| GDSTarget Model=OPT-6.7b2026.03 | 0.99 | 99 | |
| GDSTarget Model=Pythia-6.9b2026.03 | 0.99 | 98 | |
| GDSTarget Model=LLaMA-7B2026.03 | 0.99 | 99 | |
| FSDTarget Model=Neo-2.7B2026.03 | 0.98 | 93 | |
| FSDTarget Model=OPT-6.7b2026.03 | 0.98 | 96 | |
| FSDTarget Model=Pythia-6.9b2026.03 | 0.98 | 93 | |
| FSDTarget Model=LLaMA-7B2026.03 | 0.98 | 91 | |
| FSDTarget Model=GPT-J-6b2026.03 | 0.97 | 89 | |
| Min-k++Target Model=GPT-J-6b2026.03 | 0.64 | 29 | |
| Min-kTarget Model=Pythia-6.9b2026.03 | 0.62 | 20 | |
| Min-kTarget Model=GPT-J-6b2026.03 | 0.6 | 20 | |
| Min-kTarget Model=LLaMA-7B2026.03 | 0.6 | 21 | |
| Min-k++Target Model=Pythia-6.9b2026.03 | 0.6 | 23 | |
| PPLTarget Model=Pythia-6.9b2026.03 | 0.59 | 19 | |
| Min-k++Target Model=LLaMA-7B2026.03 | 0.58 | 20 | |
| PPLTarget Model=LLaMA-7B2026.03 | 0.56 | 21 | |
| Min-k++Target Model=Neo-2.7B2026.03 | 0.54 | 13 | |
| ZLibTarget Model=Pythia-6.9b2026.03 | 0.49 | 17 | |
| Min-k++Target Model=OPT-6.7b2026.03 | 0.49 | 9 | |
| ZLibTarget Model=LLaMA-7B2026.03 | 0.48 | 18 | |
| Min-kTarget Model=Neo-2.7B2026.03 | 0.45 | 5 | |
| Min-kTarget Model=OPT-6.7b2026.03 | 0.4 | 3 | |
| ZLibTarget Model=GPT-J-6b2026.03 | 0.38 | 13 | |
| PPLTarget Model=Neo-2.7B2026.03 | 0.29 | 2 | |
| PPLTarget Model=OPT-6.7b2026.03 | 0.23 | 1 | |
| PPLTarget Model=GPT-J-6b2026.03 | 0.22 | 13 | |
| ZLibTarget Model=Neo-2.7B2026.03 | 0.2 | 2 | |
| ZLibTarget Model=OPT-6.7b2026.03 | 0.15 | 0 |