Mathematical Reasoning on MathInstruct
55.88GSM8K ScoreParaBlock
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ParaBlockBackbone=Llama 3-8B2025.11 | 55.88 | 15.8 | |
| Fed full FTBackbone=Llama 3-8B2025.11 | 55.8 | 15.5 | |
| FedBCDBackbone=Llama 3-8B2025.11 | 54.74 | 24.9 | |
| FedITBackbone=Llama 3-8B2025.11 | 54.6 | 23.1 | |
| FFA-LoRABackbone=Llama 3-8B2025.11 | 54.59 | 21.2 | |
| FLoRABackbone=Llama 3-8B2025.11 | 52.54 | 64.9 | |
| BaseBackbone=Llama 3-8B2025.11 | 51.55 | — | |
| FedCyBGDBackbone=Llama 3-8B2025.11 | 51.4 | 63.2 | |
| Fed full FTBackbone=Llama 3.2-3B2025.11 | 32.22 | 12.3 | |
| FedBCDBackbone=Llama 3.2-3B2025.11 | 31.84 | 17.3 | |
| ParaBlockBackbone=Llama 3.2-3B2025.11 | 31.77 | 10.1 | |
| FFA-LoRABackbone=Llama 3.2-3B2025.11 | 30.55 | 14.9 | |
| FedITBackbone=Llama 3.2-3B2025.11 | 29.87 | 15.4 | |
| FLoRABackbone=Llama 3.2-3B2025.11 | 28.51 | 29.3 | |
| BaseBackbone=Llama 3.2-3B2025.11 | 27.98 | — | |
| FedCyBGDBackbone=Llama 3.2-3B2025.11 | 27.6 | 53.3 |