Lyrics Translation on MAVL Dubbed Lyrics ←→ Translated Lyrics 1.0
1.299Syllable Error (SE) - ESSylAVL-CoT (Gemini 2.5)
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SylAVL-CoT (Gemini 2.5)Syllable Constraint (SC)=true, Input Modality=Multimodal, Backbone=Gemini 2.5 Flash2025.05 | 1.299 | 1.269 | 1.2 | 2.979 | 0.12 | 0.139 | 0.116 | 0.214 | 61.1 | 60.3 | 44.9 | 72.8 | |
| SylAVL-CoT (Gemini 2.0)Syllable Constraint (SC)=true, Input Modality=Multimodal, Backbone=Gemini 2.0 Flash2025.05 | 1.349 | 1.363 | 1.261 | 3.107 | 0.125 | 0.149 | 0.122 | 0.223 | 63.4 | 63.1 | 47.2 | 75.9 | |
| GPT-4oSyllable Constraint (SC)=true, Input Modality=Text-only2025.05 | 2.403 | 1.723 | 3.067 | 6.94 | 0.162 | 0.183 | 0.212 | 0.338 | 74.2 | 70.9 | 90.6 | 90.6 | |
| Gemini 2.0Syllable Constraint (SC)=true, Input Modality=Text-only2025.05 | 2.61 | 1.703 | 2.941 | 5.996 | 0.163 | 0.15 | 0.205 | 0.382 | 75.9 | 66.7 | 81.3 | 91.7 | |
| Qwen2.5-72BSyllable Constraint (SC)=true, Input Modality=Text-only2025.05 | 5.185 | 2.893 | 6.229 | 9.703 | 0.279 | 0.222 | 0.37 | 0.509 | 87.6 | 75.8 | 89.8 | 94.2 | |
| Google TranslateSyllable Constraint (SC)=false, Input Modality=Text-only2025.05 | 6.513 | 4.157 | 11.848 | 20.398 | 0.34 | 0.272 | 0.624 | 0.928 | 88.6 | 80.6 | 94.4 | 96.7 | |
| GPT-4oSyllable Constraint (SC)=false, Input Modality=Text-only2025.05 | 6.717 | 4.237 | 9.907 | 16.227 | 0.341 | 0.289 | 0.538 | 0.768 | 89.4 | 81.4 | 93.1 | 97.4 | |
| Qwen2.5-72BSyllable Constraint (SC)=false, Input Modality=Text-only2025.05 | 6.745 | 4.158 | 9.518 | 15.165 | 0.351 | 0.275 | 0.523 | 0.928 | 90 | 80.7 | 93.6 | 96.4 | |
| Gemini 2.0Syllable Constraint (SC)=false, Input Modality=Text-only2025.05 | 7.347 | 4.658 | 10.436 | 16.364 | 0.377 | 0.299 | 0.56 | 0.772 | 90.8 | 83.1 | 93.6 | 96.4 | |
| mBART-50Syllable Constraint (SC)=false, Input Modality=Text-only2025.05 | 24.481 | 4.424 | 12.651 | 15.182 | 0.126 | 0.292 | 0.655 | 0.729 | 92.9 | 83.7 | 95 | 94.5 |