Instruction Following on Wizard
4.24MT-Bench ScoreLoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRAStrategy=Centralized, Foundation model=Llama22024.09 | 4.24 | |
| FLORAStrategy=Homo, Foundation model=Llama22024.09 | 4.22 | |
| FLORAStrategy=Heter, Foundation model=Llama22024.09 | 4.17 | |
| FedITStrategy=Homo, Foundation model=Llama22024.09 | 4.03 | |
| Zero-paddingStrategy=Heter, Foundation model=Llama22024.09 | 4.01 |