Subtitle Translation on MuSC zh⇒th 1.0 (test)
91.9AccuracyQwen2.5-14B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen2.5-14BTraining=ALPO2026.02 | 91.9 | 84.7 | 74.2 | |
| Qwen-MaxTraining=ICL (C)2026.02 | 91.3 | 85.8 | 69.1 | |
| DeepSeek-V3.1Training=ICL (C)2026.02 | 89.9 | 84.6 | 67.1 | |
| GPT-5Training=ICL (R)2026.02 | 88.7 | 83.9 | 73 | |
| GPT-4oTraining=ICL (C)2026.02 | 88 | 84.4 | 67.9 | |
| DeepSeek-R1Training=ICL (R)2026.02 | 87.6 | 84 | 71 | |
| Qwen2.5-14BTraining=SFT2026.02 | 87.3 | 82.6 | 66 | |
| Gold ReferenceTraining=Human2026.02 | 76.6 | 75.1 | 66.3 | |
| Google TranslateTraining=ST2026.02 | 55.2 | 56.2 | 54.5 | |
| MADLAD-10BTraining=ST2026.02 | 47.9 | 50.8 | 51 | |
| NLLB-3.3BTraining=ST2026.02 | 42.6 | 33.9 | 40.5 | |
| VideoDubberTraining=ST2026.02 | 34.1 | 34.9 | 41.5 |