Text Generation on DBpedia (test)
28.85PerplexityGPT2-Large
Evaluation results
| Method | Links | |
|---|---|---|
| GPT2-LargeTraining=DP-SGD, epsilon=1, Teacher=None2024.03 | 28.85 | |
| DistilDPModel=DistilGPT2, Training=DistilDP, epsilon=2, Teacher=GPT2-Large2024.03 | 49.11 | |
| DistilGPT2 (DPKD)Training=DPKD, epsilon=2, Teacher=GPT2-Large2024.03 | 59.85 | |
| DistilGPT2 (DP Syn Data)Training=DP Syn Data, epsilon=2, Teacher=GPT2-Large2024.03 | 59.87 | |
| DistilGPT2 (DP-SGD)Training=DP-SGD, epsilon=2, Teacher=None2024.03 | 60.81 | |
| DistilGPT2 (Zero-shot)Training=Zero-shot, epsilon=0, Teacher=None2024.03 | 83 |