Mathematical Reasoning on MT-B
5.1MT-B ScoreParaBlock
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ParaBlockBackbone=Llama 3-8B, Training Dataset=MathInstruct, Fine-tuning Setting=50 clients cross-silo settings, 20% partial participation, Number of Clients=502025.11 | 5.1 | 28.45 | |
| FedBCDBackbone=Llama 3-8B, Training Dataset=MathInstruct, Fine-tuning Setting=50 clients cross-silo settings, 20% partial participation, Number of Clients=502025.11 | 5.08 | 55.36 | |
| FedITBackbone=Llama 3-8B, Training Dataset=MathInstruct, Fine-tuning Setting=50 clients cross-silo settings, 20% partial participation, Number of Clients=502025.11 | 5.06 | 49.31 |