Personalized Federated Learning on Fed-LLM Large-Scale (52 clients) (Others)
15.71AlastFedMosaic
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FedMosaicModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 15.71 | 14.77 | |
| PerAdaModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 14.66 | 13.79 | |
| FedMKTModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 14.38 | 13.89 | |
| SFTModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 14.18 | 13.7 | |
| FedITModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 14.03 | 13.68 | |
| FedDPAModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 13.98 | 13.66 | |
| FedDATModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 13.72 | 13.02 | |
| FedSimModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 12.62 | 12.6 | |
| TAKFLModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 11.36 | 12.57 |