List your company
ResearchFormerly WizWand

MMLU Evaluation on Alpaca

32.26AccuracyFLoRIST [τ*]
22.296824.883427.4730.0566Jun 10, 2025
Updated 5mo ago

Evaluation results

MethodLinks
FLoRIST [τ*]Model=TinyLlama, Client Configuration=HOMO2025.0632.26350,800
FLoRIST [τ=0.9]Model=TinyLlama, Client Configuration=HOMO2025.0631.68600,600
FFA-LoRAModel=TinyLlama, Client Configuration=HOMO2025.0631.58284,000
FLoRIST [τ*]Model=TinyLlama, Client Configuration=HETER2025.0631.33450,900
FedIT (ZERO-PAD)Model=TinyLlama, Client Configuration=HETER2025.0631.0435,500
FLoRIST [τ*]Model=LLAMA-3.2-1B, Client Configuration=HETER2025.0630.53452,200
FLoRIST [τ*]Model=LLAMA-3.2-1B, Client Configuration=HOMO2025.0630.46333,000
FLoRIST [τ=0.9]Model=LLAMA-3.2-1B, Client Configuration=HETER2025.0630.24482,400
FLoRAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.0630.1520,600
FLEXLORAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.0629.95164,400
FLoRIST [τ=0.9]Model=LLAMA-3.2-1B, Client Configuration=HOMO2025.0629.73334,200
FLoRIST [τ=0.9]Model=TinyLlama, Client Configuration=HETER2025.0629.69349,000
FLEXLORAModel=TinyLlama, Client Configuration=HETER2025.0629.61119,600
FedITModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.0629.44195,000
FLEXLORAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.0629.24195,000
FLEXLORAModel=TinyLlama, Client Configuration=HOMO2025.0629.22142,000
FFA-LoRAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.0629.18390,600
FLoRAModel=LLAMA-3.2-1B, Client Configuration=HOMO2025.0629.1624,400
FLoRAModel=TinyLlama, Client Configuration=HOMO2025.0628.9917,800
FLoRAModel=TinyLlama, Client Configuration=HETER2025.0628.585,000
FedIT (ZERO-PAD)Model=LLAMA-3.2-1B, Client Configuration=HETER2025.0628.3748,800
FedITModel=TinyLlama, Client Configuration=HOMO2025.0628.35142,000
FFA-LoRAModel=TinyLlama, Client Configuration=HETER2025.0623.1971,000
FFA-LoRAModel=LLAMA-3.2-1B, Client Configuration=HETER2025.0622.6897,700