Communication Cost Analysis on Llama 3.2 3B
31Upload Size (MB)FedSRD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FedSRDModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float32, Download Sparsity=80%2025.10 | 31 | 43 | 74 | |
| FedSRD-eModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float32, Download Sparsity=80%2025.10 | 31 | 43 | 74 | |
| Fed-DAREModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float32, Upload Sparsity=90%, Download Sparsity=>60%2025.10 | 48.7 | 141.5 | 190 | |
| FFA-LoRAModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float322025.10 | 185.5 | 185.5 | 371 | |
| FedICUModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float32, Sparsity=≈50%2025.10 | 197 | 371 | 568 | |
| FedAvgModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float322025.10 | 371 | 371 | 742 | |
| FedProxModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float322025.10 | 371 | 371 | 742 | |
| FlexLoRAModel=Llama3.2-3B, LoRA rank (r)=64, Precision=float322025.10 | 371 | 371 | 742 |