Subtitle Translation on subtitle dataset en-fr
94.9Translation ScoreDeepSeek-V3.1
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeepSeek-V3.1Training Mode=ICL (C)2026.01 | 94.9 | 66.2 | 87.3 | 90.7 | 72.3 | |
| Qwen-MaxTraining Mode=ICL (C)2026.01 | 94.1 | 67.3 | 88.2 | 89.9 | 71.6 | |
| Qwen2.5-14B (pi_st)Training Mode=SAPO2026.01 | 94.1 | 78 | 94.2 | 89.2 | 78.8 | |
| DeepSeek-R1Training Mode=ICL (R)2026.01 | 93.6 | 69.2 | 89.2 | 90 | 73.4 | |
| GPT-4oTraining Mode=ICL (C)2026.01 | 93.2 | 68.4 | 85.4 | 88.8 | 69.5 | |
| GPT-5Training Mode=ICL (R)2026.01 | 92.2 | 74.3 | 91 | 90.4 | 75.8 | |
| Google TranslateTraining Mode=ST2026.01 | 91.9 | — | — | 84.8 | 64.3 | |
| Qwen2.5-14B (pi_sft)Training Mode=SFT2026.01 | 86.2 | 77.2 | 93.9 | 85.4 | 67.7 | |
| Gold ReferenceTraining Mode=Human2026.01 | 83.5 | — | — | 85 | 74.8 | |
| NLLB-3.3BTraining Mode=ST2026.01 | 76.9 | — | — | 74.6 | 61.8 | |
| MADLAD-10BTraining Mode=ST2026.01 | 73.6 | — | — | 67.8 | 57.4 | |
| VideoDubberTraining Mode=ST2026.01 | 48.2 | — | — | 47.3 | 48.5 |