Lyric Translation on Lyric Translation English Lyrics reference
50.38Score (ES)MBart-50
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MBart-50Singability Constraint=w/o SC2025.05 | 50.38 | 26.83 | 35.71 | 32.13 | |
| Gemini 2.0Singability Constraint=w/o SC2025.05 | 27.06 | 27.59 | 33.9 | 33.3 | |
| GPT-4oSingability Constraint=w/o SC2025.05 | 26.92 | 27.18 | 32.29 | 32.68 | |
| Qwen2.5-72BSingability Constraint=w/o SC2025.05 | 26.62 | 26.89 | 33.24 | 31.78 | |
| Google TranslateSingability Constraint=w/o SC2025.05 | 26.25 | 26.7 | 34.29 | 35.65 | |
| Qwen2.5-72BSingability Constraint=w/ SC2025.05 | 25.82 | 25.81 | 29.22 | 28.6 | |
| Gemini 2.0Singability Constraint=w/ SC2025.05 | 24.1 | 24.97 | 26.7 | 26.63 | |
| GPT-4oSingability Constraint=w/ SC2025.05 | 23.51 | 23.73 | 26.11 | 26.73 | |
| Human Expert2025.05 | 23.22 | 24.41 | 25.07 | 25.4 | |
| SylAVL-CoTBackbone=Gemini 2.0, Singability Constraint=w/ SC2025.05 | 23.16 | 24.07 | 25.2 | 25.88 | |
| SylAVL-CoTBackbone=Gemini 2.5, Singability Constraint=w/ SC2025.05 | 23.14 | 24.13 | 25.23 | 25.9 |