Next Word Prediction on Stackoverflow (test)
99Test AccuracyNon-DP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Non-DPModel=BERT2026.05 | 99 | — | — | — | |
| Pub. KFACModel=BERT, epsilon=10, Mode=Public data preconditioner2026.05 | 98.3 | — | — | — | |
| Pub. KFACModel=BERT, epsilon=8, Mode=Public data preconditioner2026.05 | 98.2 | — | — | — | |
| Pub. KFACModel=BERT, epsilon=5, Mode=Public data preconditioner2026.05 | 98.1 | — | — | — | |
| Pub. KFACModel=BERT, epsilon=3, Mode=Public data preconditioner2026.05 | 97.9 | — | — | — | |
| Pub. KFACModel=BERT, epsilon=2, Mode=Public data preconditioner2026.05 | 97.5 | — | — | — | |
| Syn. KFACModel=BERT, epsilon=10, Mode=Synthetic noise2026.05 | 96.6 | — | — | — | |
| Syn. KFACModel=BERT, epsilon=8, Mode=Synthetic noise2026.05 | 96.5 | — | — | — | |
| Syn. KFACModel=BERT, epsilon=5, Mode=Synthetic noise2026.05 | 96.4 | — | — | — | |
| Pub. KFACModel=BERT, epsilon=1, Mode=Public data preconditioner2026.05 | 96.1 | — | — | — | |
| Syn. KFACModel=BERT, epsilon=3, Mode=Synthetic noise2026.05 | 95.9 | — | — | — | |
| Syn. KFACModel=BERT, epsilon=2, Mode=Synthetic noise2026.05 | 95.4 | — | — | — | |
| DP-SGDModel=BERT, epsilon=102026.05 | 94.8 | — | — | — | |
| DP-SGDModel=BERT, epsilon=82026.05 | 94.6 | — | — | — | |
| DP-SGDModel=BERT, epsilon=52026.05 | 94.2 | — | — | — | |
| DP-SGDModel=BERT, epsilon=32026.05 | 93.6 | — | — | — | |
| DP-SGDModel=BERT, epsilon=22026.05 | 92.9 | — | — | — | |
| Syn. KFACModel=BERT, epsilon=1, Mode=Synthetic noise2026.05 | 91.8 | — | — | — | |
| Pub. KFACModel=BERT, epsilon=0.5, Mode=Public data preconditioner2026.05 | 89.8 | — | — | — | |
| DP-SGDModel=BERT, epsilon=12026.05 | 89.5 | — | — | — | |
| Syn. KFACModel=BERT, epsilon=0.5, Mode=Synthetic noise2026.05 | 81.3 | — | — | — | |
| DP-SGDModel=BERT, epsilon=0.52026.05 | 78.9 | — | — | — | |
| APFL2022.11 | — | 69.66 | — | — | |
| APFL2022.11 | — | — | 22.96 | 25.7 | |
| DITTO2022.11 | — | 74.59 | — | — | |
| DITTO2022.11 | — | — | 22.59 | 24.36 | |
| FEDAVG2022.11 | — | — | 23.15 | — | |
| FEDAVGFT2022.11 | — | 79.26 | — | — | |
| FEDAVGFT2022.11 | — | — | 23.83 | 24.41 | |
| FEDREP2022.11 | — | 91.53 | — | — | |
| FEDREP2022.11 | — | — | 18.92 | 21.04 | |
| Flow2022.11 | — | 92.74 | — | — | |
| Flow2022.11 | — | — | 26.64 | 29.49 | |
| HYPCLUSTER2022.11 | — | 80.46 | — | — | |
| HYPCLUSTER2022.11 | — | — | 23.75 | 22.43 | |
| KNNPER2022.11 | — | 82.73 | — | — | |
| KNNPER2022.11 | — | — | 23.16 | 24.49 | |
| LGFEDAVG2022.11 | — | 83.47 | — | — | |
| LGFEDAVG2022.11 | — | — | 22.61 | 24.03 | |
| LOCAL2022.11 | — | — | — | 15.93 |