Regression on California Housing (MSE, R2 Score)
0.0028MSEBlock-Wise LoRA-MoE (Global)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Block-Wise LoRA-MoE (Global)Trainable Parameters=2602026.07 | 0.0028 | 99.65 | |
| Cell-Wise LoRA-MoE (Decentralized)Trainable Parameters=2722026.07 | 0.004 | 99.51 | |
| Localized LoRATrainable Parameters=2562026.07 | 0.4106 | 49.61 | |
| LoRATrainable Parameters=2562026.07 | 0.4424 | 45.7 | |
| MELoRATrainable Parameters=2562026.07 | 0.8781 | -7.78 |