Knowledge generalization on MMLU OpenOrca
44.52MMLU OpenOrca ScoreFLoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FLoRAFoundation Model=LLaMA22026.05 | 44.52 | 11.53 | |
| FedCoFiTFoundation Model=LLaMA22026.05 | 44.28 | 0.001 | |
| FlexLoRAFoundation Model=LLaMA22026.05 | 43.96 | 2.1 | |
| Centralized (LoRA)Foundation Model=LLaMA22026.05 | 43.85 | — | |
| FedITFoundation Model=LLaMA22026.05 | 42.06 | 1.57 | |
| FedCoFiTFoundation Model=LLaMA2026.05 | 35.78 | 0.001 | |
| FLoRAFoundation Model=LLaMA2026.05 | 35.21 | 13.75 | |
| Centralized (LoRA)Foundation Model=LLaMA2026.05 | 35.19 | — | |
| FlexLoRAFoundation Model=LLaMA2026.05 | 34.62 | 2.5 | |
| FedITFoundation Model=LLaMA2026.05 | 31.74 | 1.88 | |
| FLoRAFoundation Model=TinyLlama2026.05 | 22.84 | 3.96 | |
| FedCoFiTFoundation Model=TinyLlama2026.05 | 22.73 | 0.001 | |
| FlexLoRAFoundation Model=TinyLlama2026.05 | 21.8 | 0.72 | |
| FedITFoundation Model=TinyLlama2026.05 | 21.38 | 0.54 | |
| Centralized (LoRA)Foundation Model=TinyLlama2026.05 | 21.36 | — |