Chat Quality Assessment on MT-Bench UltraChat
6.21Quality ScoreFLoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FLoRAFoundation Model=LLaMA22026.05 | 6.21 | 5.77 | |
| FedCoFiTFoundation Model=LLaMA22026.05 | 6.19 | 0.003 | |
| FlexLoRAFoundation Model=LLaMA22026.05 | 6.14 | 1.05 | |
| Centralized (LoRA)Foundation Model=LLaMA22026.05 | 6.13 | — | |
| FedITFoundation Model=LLaMA22026.05 | 6.03 | 0.52 | |
| FedCoFiTFoundation Model=LLaMA2026.05 | 3.34 | 0.002 | |
| FLoRAFoundation Model=LLaMA2026.05 | 3.31 | 6.875 | |
| FlexLoRAFoundation Model=LLaMA2026.05 | 3.27 | 1.25 | |
| Centralized (LoRA)Foundation Model=LLaMA2026.05 | 3.25 | — | |
| FedITFoundation Model=LLaMA2026.05 | 3.17 | 0.625 | |
| FLoRAFoundation Model=TinyLlama2026.05 | 3.1 | 1.98 | |
| FedCoFiTFoundation Model=TinyLlama2026.05 | 2.97 | 0.002 | |
| FlexLoRAFoundation Model=TinyLlama2026.05 | 2.84 | 0.36 | |
| FedITFoundation Model=TinyLlama2026.05 | 2.65 | 0.18 | |
| Centralized (LoRA)Foundation Model=TinyLlama2026.05 | 2.61 | — |