Commonsense Reasoning on Commonsense-15K
53.33ARC-Challenge AccuracyUB-SMoE
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| UB-SMoEBackbone=dense OLMo-1B, Budget=beta_42026.05 | 53.33 | 71.84 | 46.97 | 35.36 | 63.2 | 69.31 | 60.39 | 50.43 | 56.36 | |
| FlexLoRABackbone=dense OLMo-1B, Budget=beta_4, client-specific ranks rc={12, 16, 24, 40}2026.05 | 26.54 | 27.4 | 51.01 | 13.58 | 26.6 | 47.77 | 35.57 | 47.75 | 34.53 | |
| HetLoRABackbone=dense OLMo-1B, Budget=beta_4, client-specific ranks rc={12, 16, 24, 40}2026.05 | 21.59 | 21.8 | 55.23 | 11.04 | 23.4 | 50.05 | 33.62 | 48.54 | 33.16 | |
| FLoRABackbone=dense OLMo-1B, Budget=beta_4, client-specific ranks rc={12, 16, 24, 40}2026.05 | 12.12 | 10.77 | 26.51 | 19.11 | 10 | 49.18 | 10.29 | 29.28 | 20.91 | |
| FLoRISTBackbone=dense OLMo-1B, Budget=beta_4, client-specific ranks rc={12, 16, 24, 40}2026.05 | 7.34 | 6.14 | 19.17 | 12.94 | 7.8 | 49.13 | 5.83 | 20.92 | 16.16 |