Next Token Prediction on BBC
40.05Next Token AccuracyDP-FT
Evaluation Results
| Method | Links | |
|---|---|---|
| DP-FTData Type=Private, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 40.05 | |
| DP-FTData Type=Private, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 39.78 | |
| DP-FTData Type=Private, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 39.32 | |
| DP-FTData Type=Private, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 39.13 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 33.92 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 33.57 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 33.49 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 33.49 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 33.49 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 33.49 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 32.84 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 32.81 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 32.25 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 31.78 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 31.54 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 30.97 | |
| DP-FTData Type=Private, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 17.97 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 13.72 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 13.51 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 13.25 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 13.07 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 13.07 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 13.07 | |
| QWENData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 13.07 | |
| DP-RFTData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 13.03 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 11.63 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 10.78 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 10.03 | |
| Aug-PEData Type=Synthetic, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 10 | |
| DP-FTData Type=Private, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 9.29 | |
| DP-FTData Type=Private, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 7.96 | |
| DP-FTData Type=Private, Size=2,000, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 6.9 |