List your company
ResearchFormerly WizWand

Data Extraction on The Pile (test)

63.4Fractional Extraction RateGPT-Neo 1.3B
6.51221.28136.0550.819May 19, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GPT-Neo 1.3Btheta=0 (no defense)2023.0563.49.213
GPT-Neo 125Mtheta=0 (no defense)2023.053515.71
GPT-Neo 1.3Btheta=0.52023.0531.69.758
GPT-Neo 125Mtheta=1.252023.0519.216.601
GPT-Neo 1.3Btheta=0.752023.0517.110.267
GPT2 1.5B2023.0516.617.155
GPT-Neo 1.3Btheta=12023.0512.810.775
GPT-Neo 125Mtheta=1.52023.0512.317.499
GPT2 124M2023.059.930.323
GPT-Neo 125Mtheta=1.752023.058.719.691