Generative task on Big Patent (test)
21.91PerplexityGPT2-Large
Evaluation results
| Method | Links | |
|---|---|---|
| GPT2-LargeTraining=DP-SGD, epsilon=1, Teacher=None2024.03 | 21.91 | |
| DistilDPModel=DistilGPT2, Training=DistilDP, epsilon=2, Teacher=GPT2-Large2024.03 | 32.43 | |
| DistilGPT2 (DPKD)Training=DPKD, epsilon=2, Teacher=GPT2-Large2024.03 | 41.2 | |
| DistilGPT2 (DP-SGD)Training=DP-SGD, epsilon=2, Teacher=None2024.03 | 41.8 | |
| DistilGPT2 (DP Syn Data)Training=DP Syn Data, epsilon=2, Teacher=GPT2-Large2024.03 | 49.26 | |
| DistilGPT2 (Zero-shot)Training=Zero-shot, epsilon=0, Teacher=None2024.03 | 57.42 |