Song Generation on Song Generation Evaluation Set (test)
87.92OVLVersBand
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VersBandInput configuration=w/ full2025.04 | 87.92 | 3.01 | 1.27 | 0.58 | 88.03 | 80.51 | — | — | — | — | — | — | — | — | — | |
| VersBandInput configuration=w/o lyrics2025.04 | 86.65 | 3.37 | 1.3 | 0.5 | 85.98 | 77.02 | — | — | — | — | — | — | — | — | — | |
| MelodyLM2025.04 | 85.23 | 3.42 | 1.35 | 0.35 | 86.44 | 75.41 | — | — | — | — | — | — | — | — | — | |
| VersBandInput configuration=w/o scores2025.04 | 85.12 | 3.38 | 1.31 | 0.48 | 85.15 | 75.91 | — | — | — | — | — | — | — | — | — | |
| Melodist2025.04 | 84.12 | 3.81 | 1.34 | 0.39 | 85.97 | 74.86 | — | — | — | — | — | — | — | — | — | |
| VersBandInput configuration=w/o prompts2025.04 | 83.49 | 3.55 | 1.35 | — | — | 74.87 | — | — | — | — | — | — | — | — | — | |
| Suno v5Access=Closed-source2026.06 | 5.72 | — | — | — | — | — | 6.38 | 6.55 | 7.1 | 6.77 | 6.17 | 7.93 | 8.68 | 93.06 | 12.4 | |
| Mureka v8Access=Closed-source2026.06 | 5.69 | — | — | — | — | — | 6.31 | 6.55 | 7.11 | 6.72 | 6.19 | 8.14 | 8.69 | 92.78 | 9.96 | |
| LeVo 2Access=Open-source2026.06 | 5.48 | — | — | — | — | — | 6.12 | 6.42 | 7.1 | 6.53 | 6.11 | 6.15 | 8.72 | 88.35 | 8.55 | |
| MiniMax Music 2.5+Access=Closed-source2026.06 | 5.22 | — | — | — | — | — | 5.87 | 6.02 | 6.83 | 6.49 | 5.6 | 7.44 | 8.72 | 93.06 | 7.8 | |
| ACE-Step 1.5Access=Open-source2026.06 | 4.76 | — | — | — | — | — | 5.71 | 5.82 | 6.1 | 5.62 | 5.7 | 7.21 | 8.35 | 89.17 | 19.35 | |
| HeartMuLaAccess=Open-source2026.06 | 4.07 | — | — | — | — | — | 4.94 | 5.05 | 5.8 | 4.98 | 4.92 | 4.42 | 7.55 | 76.11 | 19.88 | |
| LeVoAccess=Open-source2026.06 | 3.71 | — | — | — | — | — | 4.47 | 4.71 | 5.87 | 4.9 | 4.52 | 4.85 | 7.58 | 73.96 | 13.55 | |
| YuEAccess=Open-source2026.06 | 3.05 | — | — | — | — | — | 4.12 | 4.17 | 4.23 | 3.89 | 3.82 | 5.45 | 7.69 | 80.28 | 20.09 | |
| DiffRhythm 2Access=Open-source2026.06 | 2.95 | — | — | — | — | — | 4.05 | 4.86 | 4.06 | 3.83 | 3.88 | 5.72 | 8.02 | 82.5 | 11.88 |