Next-token prediction on WikiText-2 BPE-2048 (val)
29.17Tail AccuracyFedAvg-fa1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FedAvg-fa1Payload=491 GB2026.06 | 29.17 | 80.9 | |
| TallyTrain+fa200Payload=2.60 GB2026.06 | 22.97 | 403.3 | |
| FedAvg-fa200Payload=2.45 GB2026.06 | 21.52 | 408.3 | |
| FedMD (pure)Payload=1,268 GB2026.06 | 15.78 | 3,622 | |
| TallyTrain (pure)Payload=0.31 GB2026.06 | 15.45 | 10,087 |