Knowledge generalization on MMLU Wizard
45.02ScoreFedCoFiT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FedCoFiTFoundation Model=LLaMA22026.05 | 45.02 | 0.004 | |
| FLoRAFoundation Model=LLaMA22026.05 | 44.57 | 11.53 | |
| FlexLoRAFoundation Model=LLaMA22026.05 | 44.29 | 2.1 | |
| FedITFoundation Model=LLaMA22026.05 | 43.29 | 1.57 | |
| Centralized (LoRA)Foundation Model=LLaMA22026.05 | 43.27 | — | |
| FLoRAFoundation Model=LLaMA2026.05 | 34.92 | 13.75 | |
| FedCoFiTFoundation Model=LLaMA2026.05 | 34.89 | 0.004 | |
| FlexLoRAFoundation Model=LLaMA2026.05 | 34.85 | 2.5 | |
| Centralized (LoRA)Foundation Model=LLaMA2026.05 | 34.28 | — | |
| FedITFoundation Model=LLaMA2026.05 | 31.46 | 1.88 | |
| FedCoFiTFoundation Model=TinyLlama2026.05 | 22.6 | 0.005 | |
| FLoRAFoundation Model=TinyLlama2026.05 | 22.25 | 3.96 | |
| FedITFoundation Model=TinyLlama2026.05 | 22.19 | 0.54 | |
| Centralized (LoRA)Foundation Model=TinyLlama2026.05 | 21.32 | — | |
| FlexLoRAFoundation Model=TinyLlama2026.05 | 21.08 | 0.72 |