Lyric Translation on Dubbed Lyrics Reference Set
44.89Translation Quality Score (ES)MBart-50
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MBart-50Singability Constraint=w/o SC2025.05 | 44.89 | 23.09 | 32.63 | 26.34 | |
| Gemini 2.0Singability Constraint=w/o SC2025.05 | 20.91 | 22.66 | 29.07 | 26.86 | |
| GPT-4oSingability Constraint=w/o SC2025.05 | 20.79 | 22.81 | 28.5 | 26.15 | |
| Qwen2.5-72BSingability Constraint=w/o SC2025.05 | 20.44 | 22.3 | 28.96 | 25.43 | |
| Google TranslateSingability Constraint=w/o SC2025.05 | 20.32 | 22.32 | 30.79 | 30.29 | |
| Qwen2.5-72BSingability Constraint=w/ SC2025.05 | 19.49 | 21.65 | 24.65 | 21.11 | |
| Gemini 2.0Singability Constraint=w/ SC2025.05 | 17.86 | 21.22 | 22.14 | 18.21 | |
| GPT-4oSingability Constraint=w/ SC2025.05 | 16.62 | 19.3 | 20.98 | 18.29 | |
| SylAVL-CoTBackbone=Gemini 2.5, Singability Constraint=w/ SC2025.05 | 16.28 | 20.05 | 20.04 | 15.41 | |
| SylAVL-CoTBackbone=Gemini 2.0, Singability Constraint=w/ SC2025.05 | 16.25 | 20.07 | 19.98 | 15.54 |