Personalized Federated Learning on Fed-LLM Large-Scale (52 clients) (Self)
14.04AlastTAKFL
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TAKFLModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 14.04 | 16.37 | |
| FedSimModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 16.29 | 16.57 | |
| FedDATModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 17.06 | 15.83 | |
| FedITModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 17.1 | 16.83 | |
| FedMKTModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 17.34 | 17.03 | |
| FedDPAModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 17.6 | 16.66 | |
| SFTModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 18.03 | 17.11 | |
| PerAdaModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 18.83 | 17.32 | |
| FedMosaicModel Setup=Heterogeneous LLMs (Llama-1B/3B), Client Count=522025.05 | 20.87 | 19.07 |