Next Token Prediction on BBC (BERT-Small Epsilon Accuracy)
25.75Accuracy (ϵ=∞)DP-FT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DP-FTData Type=Private / full data, Size=10,0002026.02 | 25.75 | 14.07 | 13.71 | 13.09 | |
| DP-FTData Type=Private, Size=2,0002026.02 | 17.97 | 9.29 | 7.96 | 6.9 | |
| DP-RFTData Type=Synthetic, Size=2,0002026.02 | 13.72 | 13.25 | 13.03 | 13.51 | |
| QWENData Type=Synthetic, Size=2,0002026.02 | 13.07 | 13.07 | 13.07 | 13.07 | |
| Aug-PEData Type=Synthetic, Size=2,0002026.02 | 11.63 | 10.78 | 10.03 | 10 |