Intent Classification on Specialized Tasks Intent
79.2Intent AccuracyFull FT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Full FTRatio=0%, # Params=6.92B2026.03 | 79.2 | 56.3 | |
| LightMoERatio=30%, # Params=0.45B2026.03 | 74.6 | 55.3 | |
| MC-SMoE*Ratio=40%, # Params=1.65B2026.03 | 74.5 | 50.2 | |
| LightMoERatio=50%, # Params=0.45B2026.03 | 74.2 | 48.1 | |
| MC-SMoE*Ratio=50%, # Params=1.65B2026.03 | 73.4 | 45.3 | |
| LoRARatio=0%, # Params=0.45B2026.03 | 73 | 55.5 | |
| LightMoERatio=40%, # Params=0.45B2026.03 | 72.6 | 53 | |
| Replace (w. shared)Ratio=30%, # Params=0.45B2026.03 | 71.4 | 52.3 | |
| MC-SMoERatio=40%, # Params=0.45B2026.03 | 70.8 | 47.3 | |
| MC-SMoERatio=30%, # Params=0.45B2026.03 | 70.2 | 53.4 | |
| MoBERatio=30%, # Params=0.45B2026.03 | 69.4 | 50.4 | |
| Replace (w/o shared)Ratio=30%, # Params=0.45B2026.03 | 69.4 | 52.6 | |
| MC-SMoERatio=50%, # Params=0.45B2026.03 | 67.2 | 42.5 | |
| Replace (w/o shared)Ratio=40%, # Params=0.45B2026.03 | 65.8 | 50.1 | |
| MoBERatio=40%, # Params=0.45B2026.03 | 65.4 | 43 | |
| Replace (w/o shared)Ratio=50%, # Params=0.45B2026.03 | 65.4 | 44.3 | |
| HC-SMoERatio=30%, # Params=0.45B2026.03 | 64 | 46.8 | |
| Replace (w. shared)Ratio=40%, # Params=0.45B2026.03 | 59 | 49.3 | |
| HC-SMoERatio=40%, # Params=0.45B2026.03 | 58.8 | 38.4 | |
| HC-SMoERatio=50%, # Params=0.45B2026.03 | 58 | 34 | |
| Replace (w. shared)Ratio=50%, # Params=0.45B2026.03 | 56.2 | 41.6 | |
| MoBERatio=50%, # Params=0.45B2026.03 | 53 | 29.9 | |
| OriginalRatio=0%, # Params=-2026.03 | 9.8 | 37.7 |