Machine Translation on Specialized Tasks Translation
37.1Translation Quality ScoreFull FT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Full FTRatio=0%, # Params=6.92B2026.03 | 37.1 | 56.3 | |
| HC-SMoERatio=30%, # Params=0.45B2026.03 | 32.4 | 46.8 | |
| MC-SMoERatio=30%, # Params=0.45B2026.03 | 30.9 | 53.4 | |
| LightMoERatio=30%, # Params=0.45B2026.03 | 30.4 | 55.3 | |
| MoBERatio=30%, # Params=0.45B2026.03 | 30.3 | 50.4 | |
| LightMoERatio=40%, # Params=0.45B2026.03 | 30.2 | 53 | |
| MoBERatio=40%, # Params=0.45B2026.03 | 29.9 | 43 | |
| LoRARatio=0%, # Params=0.45B2026.03 | 29.2 | 55.5 | |
| MC-SMoE*Ratio=40%, # Params=1.65B2026.03 | 28.4 | 50.2 | |
| Replace (w/o shared)Ratio=30%, # Params=0.45B2026.03 | 27 | 52.6 | |
| Replace (w. shared)Ratio=40%, # Params=0.45B2026.03 | 25.9 | 49.3 | |
| Replace (w/o shared)Ratio=40%, # Params=0.45B2026.03 | 24.7 | 50.1 | |
| Replace (w. shared)Ratio=30%, # Params=0.45B2026.03 | 23.6 | 52.3 | |
| MoBERatio=50%, # Params=0.45B2026.03 | 21.6 | 29.9 | |
| MC-SMoE*Ratio=50%, # Params=1.65B2026.03 | 18.5 | 45.3 | |
| HC-SMoERatio=40%, # Params=0.45B2026.03 | 16.9 | 38.4 | |
| OriginalRatio=0%, # Params=-2026.03 | 13.6 | 37.7 | |
| LightMoERatio=50%, # Params=0.45B2026.03 | 13.5 | 48.1 | |
| Replace (w/o shared)Ratio=50%, # Params=0.45B2026.03 | 13 | 44.3 | |
| HC-SMoERatio=50%, # Params=0.45B2026.03 | 11.6 | 34 | |
| MC-SMoERatio=40%, # Params=0.45B2026.03 | 10.8 | 47.3 | |
| MC-SMoERatio=50%, # Params=0.45B2026.03 | 7.2 | 42.5 | |
| Replace (w. shared)Ratio=50%, # Params=0.45B2026.03 | 6.7 | 41.6 |