MMLU Evaluation on Alpaca
32.26AccuracyFLoRIST [τ*]
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FLoRIST [τ*]Model=TinyLlama, Client Configuration=HOMO2025.06 | 32.26 | 350,800 | |
| FLoRIST [τ=0.9]Model=TinyLlama, Client Configuration=HOMO2025.06 | 31.68 | 600,600 | |
| FFA-LoRAModel=TinyLlama, Client Configuration=HOMO2025.06 | 31.58 | 284,000 | |
| FLoRIST [τ*]Model=TinyLlama, Client Configuration=HETER2025.06 | 31.33 | 450,900 | |
| FedIT (ZERO-PAD)Model=TinyLlama, Client Configuration=HETER2025.06 | 31.04 | 35,500 | |
| FLoRIST [τ*]Model=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 30.53 | 452,200 | |
| FLoRIST [τ*]Model=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 30.46 | 333,000 | |
| FLoRIST [τ=0.9]Model=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 30.24 | 482,400 | |
| FLoRAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 30.15 | 20,600 | |
| FLEXLORAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 29.95 | 164,400 | |
| FLoRIST [τ=0.9]Model=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 29.73 | 334,200 | |
| FLoRIST [τ=0.9]Model=TinyLlama, Client Configuration=HETER2025.06 | 29.69 | 349,000 | |
| FLEXLORAModel=TinyLlama, Client Configuration=HETER2025.06 | 29.61 | 119,600 | |
| FedITModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 29.44 | 195,000 | |
| FLEXLORAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 29.24 | 195,000 | |
| FLEXLORAModel=TinyLlama, Client Configuration=HOMO2025.06 | 29.22 | 142,000 | |
| FFA-LoRAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 29.18 | 390,600 | |
| FLoRAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.06 | 29.16 | 24,400 | |
| FLoRAModel=TinyLlama, Client Configuration=HOMO2025.06 | 28.99 | 17,800 | |
| FLoRAModel=TinyLlama, Client Configuration=HETER2025.06 | 28.58 | 5,000 | |
| FedIT (ZERO-PAD)Model=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 28.37 | 48,800 | |
| FedITModel=TinyLlama, Client Configuration=HOMO2025.06 | 28.35 | 142,000 | |
| FFA-LoRAModel=TinyLlama, Client Configuration=HETER2025.06 | 23.19 | 71,000 | |
| FFA-LoRAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.06 | 22.68 | 97,700 |