Mathematical Reasoning on GSM8K (Accuracy, RT(m))
53.9GSM8K AccuracyParaBlock
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ParaBlockBackbone=Llama 3-8B, Training Dataset=MathInstruct, Fine-tuning Setting=50 clients cross-silo settings, 20% partial participation, Number of Clients=502025.11 | 53.9 | 28.44 | |
| FedITBackbone=Llama 3-8B, Training Dataset=MathInstruct, Fine-tuning Setting=50 clients cross-silo settings, 20% partial participation, Number of Clients=502025.11 | 53.75 | 44.15 | |
| FedBCDBackbone=Llama 3-8B, Training Dataset=MathInstruct, Fine-tuning Setting=50 clients cross-silo settings, 20% partial participation, Number of Clients=502025.11 | 53.6 | 52.16 |