Intent Classification on Intent (test)
81.2Intent AccuracyLightMoE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LightMoERatio=30%, # Params=0.96B2026.03 | 81.2 | 51.4 | |
| LoRARatio=0%, # Params=0.96B2026.03 | 81 | 52 | |
| MoBERatio=30%, # Params=0.96B2026.03 | 80.2 | 53.8 | |
| LightMoERatio=40%, # Params=0.96B2026.03 | 80 | 50.9 | |
| LightMoERatio=50%, # Params=0.96B2026.03 | 79.4 | 48.4 | |
| HC-SMoERatio=30%, # Params=0.96B2026.03 | 75.8 | 49.8 | |
| HC-SMoERatio=50%, # Params=0.96B2026.03 | 72.4 | 45.8 | |
| HC-SMoERatio=40%, # Params=0.96B2026.03 | 72.2 | 48.9 | |
| MoBERatio=40%, # Params=0.96B2026.03 | 71.2 | 49 | |
| MoBERatio=50%, # Params=0.96B2026.03 | 63.8 | 38.6 | |
| MC-SMoERatio=40%, # Params=0.96B2026.03 | 61.8 | 48.4 | |
| MC-SMoERatio=30%, # Params=0.96B2026.03 | 60.6 | 49.3 | |
| MC-SMoERatio=50%, # Params=0.96B2026.03 | 47.6 | 40.4 | |
| OriginalRatio=0%, # Params=-2026.03 | 0 | 26.2 |