Next Token Prediction on WildChat (BERT-Small Accuracy)
28.78BERT-Small Next Token Accuracy (eps=inf)DP-FT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DP-FTData Type=Private / full data, Size=10,0002026.02 | 28.78 | 13.93 | 13.52 | 12.8 | |
| DP-FTData Type=Private, Size=2,0002026.02 | 19.62 | 8.28 | 7.37 | 5.3 | |
| DP-RFTData Type=Synthetic, Size=2,0002026.02 | 13.93 | 14.08 | 14.14 | 13.89 | |
| Aug-PEData Type=Synthetic, Size=2,0002026.02 | 13.29 | 14.04 | 13.81 | 13.63 | |
| QWENData Type=Synthetic, Size=2,0002026.02 | 5.22 | 5.22 | 5.22 | 5.22 |