Instruction Tuning on FLAN subset Average (test)
56.7ROUGE-1FedRouter*
Evaluation Results
| Method | Links | |
|---|---|---|
| FedRouter*Backbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16), Budget strategy=flexible2026.03 | 56.7 | |
| FedRouterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 56.2 | |
| FedClusterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.5 | |
| FedITBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.2 | |
| FedDPABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.2 | |
| FedSABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 53.8 | |
| LocalBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 53.7 |