Subtitle Translation on ko-zh subtitle dataset
84.5Translation ScoreGPT-5
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-5Training Mode=ICL (R)2026.01 | 84.5 | 75.3 | 90.2 | 82.6 | 65 | |
| Qwen2.5-14B (pi_st)Training Mode=SAPO2026.01 | 84.3 | 80.2 | 94.2 | 83.3 | 70.5 | |
| Qwen-MaxTraining Mode=ICL (C)2026.01 | 83.7 | 72.3 | 87.3 | 82.5 | 61.8 | |
| DeepSeek-V3.1Training Mode=ICL (C)2026.01 | 83.1 | 70.2 | 88.4 | 82.2 | 57.2 | |
| Qwen2.5-14B (pi_sft)Training Mode=SFT2026.01 | 80.9 | 81.3 | 95.9 | 76.1 | 53.9 | |
| GPT-4oTraining Mode=ICL (C)2026.01 | 80 | 76.2 | 86.3 | 79.9 | 58.1 | |
| DeepSeek-R1Training Mode=ICL (R)2026.01 | 79.8 | 75.3 | 91.3 | 81.6 | 65.6 | |
| Gold ReferenceTraining Mode=Human2026.01 | 78 | — | — | 77.8 | 65.8 | |
| Google TranslateTraining Mode=ST2026.01 | 54.9 | — | — | 52.8 | 52 | |
| MADLAD-10BTraining Mode=ST2026.01 | 44.9 | — | — | 42.9 | 46.7 | |
| VideoDubberTraining Mode=ST2026.01 | 39.6 | — | — | 45.2 | 48.2 | |
| NLLB-3.3BTraining Mode=ST2026.01 | 33.1 | — | — | 26.1 | 25.4 |