List your company
ResearchFormerly WizWand

Pre-training data detection on BookMIA (test)

0.99AUROCGDS
0.11640.34320.570.7968Mar 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
GDSTarget Model=Neo-2.7B2026.030.9998
GDSTarget Model=GPT-J-6b2026.030.9999
GDSTarget Model=OPT-6.7b2026.030.9999
GDSTarget Model=Pythia-6.9b2026.030.9998
GDSTarget Model=LLaMA-7B2026.030.9999
FSDTarget Model=Neo-2.7B2026.030.9893
FSDTarget Model=OPT-6.7b2026.030.9896
FSDTarget Model=Pythia-6.9b2026.030.9893
FSDTarget Model=LLaMA-7B2026.030.9891
FSDTarget Model=GPT-J-6b2026.030.9789
Min-k++Target Model=GPT-J-6b2026.030.6429
Min-kTarget Model=Pythia-6.9b2026.030.6220
Min-kTarget Model=GPT-J-6b2026.030.620
Min-kTarget Model=LLaMA-7B2026.030.621
Min-k++Target Model=Pythia-6.9b2026.030.623
PPLTarget Model=Pythia-6.9b2026.030.5919
Min-k++Target Model=LLaMA-7B2026.030.5820
PPLTarget Model=LLaMA-7B2026.030.5621
Min-k++Target Model=Neo-2.7B2026.030.5413
ZLibTarget Model=Pythia-6.9b2026.030.4917
Min-k++Target Model=OPT-6.7b2026.030.499
ZLibTarget Model=LLaMA-7B2026.030.4818
Min-kTarget Model=Neo-2.7B2026.030.455
Min-kTarget Model=OPT-6.7b2026.030.43
ZLibTarget Model=GPT-J-6b2026.030.3813
PPLTarget Model=Neo-2.7B2026.030.292
PPLTarget Model=OPT-6.7b2026.030.231
PPLTarget Model=GPT-J-6b2026.030.2213
ZLibTarget Model=Neo-2.7B2026.030.22
ZLibTarget Model=OPT-6.7b2026.030.150