Subtitle Translation on zh-th subtitle dataset
91.9Translation ScoreQwen2.5-14B (pi_st)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen2.5-14B (pi_st)Training Mode=SAPO2026.01 | 91.9 | 85.6 | 93.2 | 84.7 | 74.2 | |
| Qwen-MaxTraining Mode=ICL (C)2026.01 | 91.3 | 72.1 | 86.2 | 85.8 | 69.1 | |
| DeepSeek-V3.1Training Mode=ICL (C)2026.01 | 89.9 | 75.5 | 86.2 | 84.6 | 67.1 | |
| GPT-5Training Mode=ICL (R)2026.01 | 88.7 | 80.2 | 88.4 | 83.9 | 73 | |
| GPT-4oTraining Mode=ICL (C)2026.01 | 88 | 73.4 | 85.3 | 84.4 | 67.9 | |
| DeepSeek-R1Training Mode=ICL (R)2026.01 | 87.6 | 76.3 | 87.3 | 84 | 71 | |
| Qwen2.5-14B (pi_sft)Training Mode=SFT2026.01 | 87.3 | 84.2 | 92.7 | 82.6 | 66 | |
| Gold ReferenceTraining Mode=Human2026.01 | 76.6 | — | — | 75.1 | 66.3 | |
| Google TranslateTraining Mode=ST2026.01 | 55.2 | — | — | 56.2 | 54.5 | |
| MADLAD-10BTraining Mode=ST2026.01 | 47.9 | — | — | 50.8 | 51 | |
| NLLB-3.3BTraining Mode=ST2026.01 | 42.6 | — | — | 33.9 | 40.5 | |
| VideoDubberTraining Mode=ST2026.01 | 34.1 | — | — | 34.9 | 41.5 |