MMLU Evaluation on Dolly
30.94AccuracyFLoRIST [τ=0.9]
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FLoRIST [τ=0.9]Model=TinyLlama, Client Configuration=HOMO2025.06 | 30.94 | 23.48 | |
| FLoRIST [τ=0.9]Model=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 29.48 | 33.64 | |
| FLoRIST [τ*]Model=TinyLlama, Client Configuration=HOMO2025.06 | 29.16 | 53.54 | |
| FLoRAModel=TinyLlama, Client Configuration=HOMO2025.06 | 28.99 | 1.78 | |
| FLoRIST [τ*]Model=TinyLlama, Client Configuration=HETER2025.06 | 28.87 | 37.87 | |
| FLEXLORAModel=TinyLlama, Client Configuration=HETER2025.06 | 28.49 | 11.96 | |
| FLoRIST [τ*]Model=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 28.28 | 51.71 | |
| FLEXLORAModel=TinyLlama, Client Configuration=HOMO2025.06 | 28.06 | 14.2 | |
| FFA-LoRAModel=TinyLlama, Client Configuration=HOMO2025.06 | 27.79 | 28.4 | |
| FLoRIST [τ=0.9]Model=TinyLlama, Client Configuration=HETER2025.06 | 27.69 | 34.93 | |
| FedITModel=TinyLlama, Client Configuration=HOMO2025.06 | 27.46 | 14.2 | |
| FLEXLORAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 27.39 | 19.5 | |
| FLoRAModel=TinyLlama, Client Configuration=HETER2025.06 | 27.2 | 0.5 | |
| FLEXLORAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 26.74 | 16.44 | |
| FFA-LoRAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 26.15 | 39.06 | |
| FedIT (ZERO-PAD)Model=TinyLlama, Client Configuration=HETER2025.06 | 25.73 | 3.55 | |
| FedITModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 25 | 19.5 | |
| FLoRIST [τ=0.9]Model=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 24.1 | 49.38 | |
| FLoRIST [τ*]Model=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 24.01 | 46.35 | |
| FLoRAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 23.85 | 2.06 | |
| FLoRAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 22.48 | 2.44 | |
| FFA-LoRAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 22.45 | 9.77 | |
| FedIT (ZERO-PAD)Model=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 21.41 | 4.88 | |
| FFA-LoRAModel=TinyLlama, Client Configuration=HETER2025.06 | 18.54 | 7.1 |