Subtitle Translation on MuSC en⇒fr 1.0 (test)
94.9AccuracyDeepSeek-V3.1
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeek-V3.1Training=ICL (C)2026.02 | 94.9 | 90.7 | 72.3 | |
| Qwen-MaxTraining=ICL (C)2026.02 | 94.1 | 89.9 | 71.6 | |
| Qwen2.5-14BTraining=ALPO2026.02 | 94.1 | 89.2 | 78.8 | |
| DeepSeek-R1Training=ICL (R)2026.02 | 93.6 | 90 | 73.4 | |
| GPT-4oTraining=ICL (C)2026.02 | 93.2 | 88.8 | 69.5 | |
| GPT-5Training=ICL (R)2026.02 | 92.2 | 90.4 | 75.8 | |
| Google TranslateTraining=ST2026.02 | 91.9 | 84.8 | 64.3 | |
| Qwen2.5-14BTraining=SFT2026.02 | 86.2 | 85.4 | 67.7 | |
| Gold ReferenceTraining=Human2026.02 | 83.5 | 85 | 74.8 | |
| NLLB-3.3BTraining=ST2026.02 | 76.9 | 74.6 | 61.8 | |
| MADLAD-10BTraining=ST2026.02 | 73.6 | 67.8 | 57.4 | |
| VideoDubberTraining=ST2026.02 | 48.2 | 47.3 | 48.5 |