Lyric Translation on MAVL Dubbed Lyrics 1.0 (test)
0.677MPNet Score (ES)Qwen2.5-72B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-72Bsyllable constraint=false2025.05 | 0.677 | 0.655 | 0.637 | 0.633 | |
| Qwen2.5-72Bsyllable constraint=true2025.05 | 0.673 | 0.632 | 0.645 | 0.649 | |
| Google Translatesyllable constraint=false2025.05 | 0.672 | 0.649 | 0.618 | 0.6 | |
| GPT-4osyllable constraint=true2025.05 | 0.672 | 0.654 | 0.647 | 0.672 | |
| Gemini 2.0syllable constraint=false2025.05 | 0.671 | 0.652 | 0.636 | 0.61 | |
| GPT-4osyllable constraint=false2025.05 | 0.67 | 0.635 | 0.633 | 0.624 | |
| SylAVL-CoTsyllable constraint=true, backbone=Gemini 2.02025.05 | 0.656 | 0.64 | 0.647 | 0.681 | |
| Gemini 2.0syllable constraint=true2025.05 | 0.654 | 0.634 | 0.651 | 0.669 | |
| SylAVL-CoTsyllable constraint=true, backbone=Gemini 2.52025.05 | 0.649 | 0.641 | 0.645 | 0.688 | |
| mBART-50syllable constraint=false2025.05 | 0.576 | 0.634 | 0.608 | 0.612 |