Instruction Tuning on FLAN Dual (test)
56.3ROUGE-1FedRouter*
Evaluation Results
| Method | Links | |
|---|---|---|
| FedRouter*Backbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16), Budget strategy=flexible2026.03 | 56.3 | |
| FedRouterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.8 | |
| FedClusterBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.1 | |
| FedDPABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55.1 | |
| FedITBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 55 | |
| FedSABackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 53 | |
| LocalBackbone=Llama 3.2-1B, PEFT=LoRA (r=8, a=16)2026.03 | 52.5 |