Instruction Tuning on FLAN All (test)
57.5ROUGE-1FedRouter*
Evaluation Results
| Method | Links | |
|---|---|---|
| FedRouter*Backbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16), Budget strategy=flexible2026.03 | 57.5 | |
| FedRouterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 56.6 | |
| FedITBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 56 | |
| FedClusterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.3 | |
| FedDPABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 54.9 | |
| LocalBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 53.4 | |
| FedSABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 53.1 |