Instruction Compliance on IFEval Dolly-15K
58.71Compliance ScoreCentralized (LoRA)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Centralized (LoRA)Foundation Model=LLaMA22026.05 | 58.71 | — | |
| FLoRAFoundation Model=LLaMA22026.05 | 58.49 | 17.3 | |
| FedCoFiTFoundation Model=LLaMA22026.05 | 57.96 | 0.006 | |
| FlexLoRAFoundation Model=LLaMA22026.05 | 57.24 | 3.14 | |
| FedCoFiTFoundation Model=LLaMA2026.05 | 54.36 | 0.006 | |
| Centralized (LoRA)Foundation Model=LLaMA2026.05 | 54.18 | — | |
| FLoRAFoundation Model=LLaMA2026.05 | 53.29 | 20.63 | |
| FlexLoRAFoundation Model=LLaMA2026.05 | 52.61 | 3.75 | |
| FedITFoundation Model=LLaMA22026.05 | 52.38 | 2.62 | |
| FedCoFiTFoundation Model=TinyLlama2026.05 | 51.19 | 0.007 | |
| FlexLoRAFoundation Model=TinyLlama2026.05 | 50.73 | 1.2 | |
| FedITFoundation Model=LLaMA2026.05 | 50.37 | 3.13 | |
| FLoRAFoundation Model=TinyLlama2026.05 | 50.26 | 11.35 | |
| Centralized (LoRA)Foundation Model=TinyLlama2026.05 | 49.32 | — | |
| FedITFoundation Model=TinyLlama2026.05 | 43.82 | 0.9 |