List your company

Lyrics Translation Semantic Evaluation on Dubbed Lyrics ↔ Translated Lyrics

0.5623MiniLM Score (ES)Gemini 2.0
0.491060.5095550.528050.546545May 24, 2025

Evaluation results

MethodLinks
Gemini 2.0Self-Consistency=false2025.050.56230.520.69460.47940.67090.65160.63590.61040.73280.73320.73180.6885
Qwen-72BSelf-Consistency=false2025.050.56220.51450.6920.4820.67720.65490.63710.63290.74230.73840.73590.7012
Qwen-72BSelf-Consistency=true2025.050.56190.49340.69930.49050.67290.63230.64480.64890.7410.73090.74160.7118
Google TranslateSelf-Consistency=false2025.050.55840.50920.66610.46190.67240.6490.61770.59950.74020.73480.71580.6824
GPT-4oSelf-Consistency=true2025.050.55730.51070.70850.50420.67220.65360.64720.67150.7450.7380.7530.7238
GPT-4oSelf-Consistency=false2025.050.55640.50010.69320.48720.67030.63540.63320.62440.73860.73210.73530.7005
SylAVL-CoT (Gemini 2.0)Self-Consistency=true2025.050.53950.49750.70160.49750.65610.64020.64670.68140.73580.730.75090.7241
Gemini 2.0Self-Consistency=true2025.050.53830.4910.69790.48710.65380.63410.65060.66870.73140.72240.74680.7152
MBart-50Self-Consistency=false2025.050.49380.48910.66710.45470.57640.63390.60750.61230.70310.72580.70360.6925