Instruction Tuning on FLAN Single (test)
56.2ROUGE-1FedRouter*
Evaluation Results
| Method | Links | |
|---|---|---|
| FedRouter*Backbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16), Budget strategy=flexible2026.03 | 56.2 | |
| FedClusterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 56.1 | |
| FedRouterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 56.1 | |
| FedDPABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.6 | |
| FedSABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.4 | |
| LocalBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.3 | |
| FedITBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 54.6 |