Code Generation on CodeAlpaca (pass@1, pass@10)
53.66Pass@1AlignFed
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AlignFedBackbone=Qwen3-8B, Protocol=Asynchronous2026.06 | 53.66 | 72.56 | |
| SynchronousBackbone=Qwen3-8B, Protocol=Synchronous2026.06 | 53.29 | 71.34 | |
| FedSA-LoRA+AlignFedBackbone=Llama3-8B2026.06 | 40.73 | 61.59 | |
| FFA-LoRA+AlignFedBackbone=Llama3-8B2026.06 | 40.3 | 62.8 | |
| FFA-LoRA+FedBuffBackbone=Llama3-8B2026.06 | 39.88 | 61.59 | |
| FFA-LoRABackbone=Llama3-8B2026.06 | 39.57 | 60.37 | |
| FedSA-LoRA+FedBuffBackbone=Llama3-8B2026.06 | 39.21 | 59.15 | |
| FedSA-LoRABackbone=Llama3-8B2026.06 | 38.6 | 60.98 | |
| FedAvgBackbone=Llama3-8B2026.06 | 37.93 | 59.76 | |
| FedAvg+FedBuffBackbone=Llama3-8B2026.06 | 37.5 | 59.76 | |
| FedAvg+AlignFedBackbone=Llama3-8B2026.06 | 37.13 | 59.15 |