List your company
ResearchFormerly WizWand

Training Data Extraction on The Pile (train)

45Exact Extract RateGPT-Neo 1.3B
-1.69610.42722.5534.673May 19, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GPT-Neo 1.3Btheta=0, Prefix Size=50, Suffix Size=50, Prompt Length=12023.0545
GPT-Neo 125Mtheta=0, Prefix Size=50, Suffix Size=50, Prompt Length=12023.0516.9
GPT-Neo 1.3Btheta=0.5, Prefix Size=50, Suffix Size=50, Prompt Length=12023.0510.8
GPT-Neo 125Mtheta=1.25, Prefix Size=50, Suffix Size=50, Prompt Length=12023.053.1
GPT-Neo 1.3Btheta=0.75, Prefix Size=50, Suffix Size=50, Prompt Length=12023.052.2
GPT2 1.5BPrefix Size=50, Suffix Size=50, Prompt Length=12023.051.9
GPT-Neo 1.3Btheta=1, Prefix Size=50, Suffix Size=50, Prompt Length=12023.051
GPT-Neo 125Mtheta=1.5, Prefix Size=50, Suffix Size=50, Prompt Length=12023.050.6
GPT2 124Mtheta=0, Prefix Size=50, Suffix Size=50, Prompt Length=12023.050.4
GPT-Neo 125Mtheta=1.75, Prefix Size=50, Suffix Size=50, Prompt Length=12023.050.1