Subtitle Translation on MuSC ko⇒zh 1.0 (test)
84.5AccuracyGPT-5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5Training=ICL (R)2026.02 | 84.5 | 82.6 | 65 | |
| Qwen2.5-14BTraining=ALPO2026.02 | 84.3 | 83.3 | 70.5 | |
| Qwen-MaxTraining=ICL (C)2026.02 | 83.7 | 82.5 | 61.8 | |
| DeepSeek-V3.1Training=ICL (C)2026.02 | 83.1 | 82.2 | 57.2 | |
| Qwen2.5-14BTraining=SFT2026.02 | 80.9 | 76.1 | 53.9 | |
| GPT-4oTraining=ICL (C)2026.02 | 80 | 79.9 | 58.1 | |
| DeepSeek-R1Training=ICL (R)2026.02 | 79.8 | 81.6 | 65.6 | |
| Gold ReferenceTraining=Human2026.02 | 78 | 77.8 | 65.8 | |
| Google TranslateTraining=ST2026.02 | 54.9 | 52.8 | 52 | |
| MADLAD-10BTraining=ST2026.02 | 44.9 | 42.9 | 46.7 | |
| VideoDubberTraining=ST2026.02 | 39.6 | 45.2 | 48.2 | |
| NLLB-3.3BTraining=ST2026.02 | 33.1 | 26.1 | 25.4 |