Lyric Translation on MAVL Korean (test)
4.32SingabilitySylAVL-CoT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SylAVL-CoTsyllable-constrained=true2025.05 | 4.32 | 3.71 | 3.95 | |
| Human Expertsyllable-constrained=true2025.05 | 3.88 | 2.94 | 3.28 | |
| Gemini 2.0syllable-constrained=true2025.05 | 3.47 | 3.29 | 3.25 | |
| GPT-4syllable-constrained=true2025.05 | 3.41 | 3.33 | 3.19 | |
| Google Translatesyllable-constrained=false2025.05 | 2.05 | 2.54 | 2.15 | |
| Qwen2.5-72Bsyllable-constrained=true2025.05 | 2 | 3.36 | 2.46 |