List your company

General Language Understanding on 8 Sub-Tasks (test)

62.3Performance on 8 Sub-TasksLoRA
50.23653.36856.559.632Mar 13, 2026

Evaluation results

MethodLinks
LoRARatio=0%, # Params=0.96B2026.0362.352
OriginalRatio=0%, # Params=-2026.0361.826.2
MoBERatio=30%, # Params=0.96B2026.0359.753.8
LightMoERatio=30%, # Params=0.96B2026.0359.251.4
HC-SMoERatio=30%, # Params=0.96B2026.0357.849.8
MoBERatio=40%, # Params=0.96B2026.0357.649
LightMoERatio=40%, # Params=0.96B2026.0357.350.9
MC-SMoERatio=30%, # Params=0.96B2026.035749.3
HC-SMoERatio=40%, # Params=0.96B2026.0355.148.9
MC-SMoERatio=40%, # Params=0.96B2026.0354.748.4
LightMoERatio=50%, # Params=0.96B2026.0354.348.4
HC-SMoERatio=50%, # Params=0.96B2026.035345.8
MC-SMoERatio=50%, # Params=0.96B2026.0351.340.4
MoBERatio=50%, # Params=0.96B2026.0350.738.6