Next Token Prediction on QMSum
47Next Token AccuracyDP-FT
Evaluation results
| Method | Links | |
|---|---|---|
| DP-FTData Type=Private data, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 47 | |
| DP-FTData Type=Private data, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 42.71 | |
| DP-FTData Type=Private data, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 42.45 | |
| DP-FTData Type=Private data, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 42.13 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 34.33 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 34.02 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 33.68 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 33.57 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 33.38 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 33.06 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 33 | |
| DP-FTData Type=Private data, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 32.82 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 32.6 | |
| QWENData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=inf2026.02 | 24 | |
| QWENData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=42026.02 | 24 | |
| QWENData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=22026.02 | 24 | |
| QWENData Type=Synthetic, Size=700, Backbone=GPT-2, Privacy Budget (epsilon)=12026.02 | 24 | |
| DP-FTData Type=Private data, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 11.52 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 11.11 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 11.03 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 10.97 | |
| DP-RFTData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 10.95 | |
| DP-FTData Type=Private data, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 9.88 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 8.53 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 8.23 | |
| DP-FTData Type=Private data, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 7.96 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 7.82 | |
| Aug-PEData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 7.63 | |
| QWENData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=inf2026.02 | 3.86 | |
| QWENData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=42026.02 | 3.86 | |
| QWENData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=22026.02 | 3.86 | |
| QWENData Type=Synthetic, Size=700, Backbone=BERTSmall, Privacy Budget (epsilon)=12026.02 | 3.86 |