Lyric Translation on MAVL French (test)
4.04SingabilitySylAVL-CoT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SylAVL-CoTsyllable-constrained=true2025.05 | 4.04 | 3.86 | 3.93 | |
| Human Expertsyllable-constrained=true2025.05 | 3.94 | 3.55 | 3.5 | |
| GPT-4syllable-constrained=true2025.05 | 3.86 | 3.86 | 3.86 | |
| Gemini 2.0syllable-constrained=true2025.05 | 3.86 | 3.65 | 3.7 | |
| Qwen2.5-72Bsyllable-constrained=true2025.05 | 3.85 | 3.89 | 3.85 | |
| Google Translatesyllable-constrained=false2025.05 | 3.39 | 3.8 | 3.57 |