Lyrics Translation Semantic Evaluation on Dubbed Lyrics ↔ Translated Lyrics benchmark leaderboard · SOTA2 Research

Lyrics Translation Semantic Evaluation on Dubbed Lyrics ↔ Translated Lyrics

0.5623MiniLM Score (ES)Gemini 2.0

Evaluation Results

Method	Links
Gemini 2.02025.05		0.5623	0.52	0.6946	0.4794	0.6709	0.6516	0.6359	0.6104	0.7328	0.7332	0.7318	0.6885
Qwen-72B2025.05		0.5622	0.5145	0.692	0.482	0.6772	0.6549	0.6371	0.6329	0.7423	0.7384	0.7359	0.7012
Qwen-72B2025.05		0.5619	0.4934	0.6993	0.4905	0.6729	0.6323	0.6448	0.6489	0.741	0.7309	0.7416	0.7118
Google Translate2025.05		0.5584	0.5092	0.6661	0.4619	0.6724	0.649	0.6177	0.5995	0.7402	0.7348	0.7158	0.6824
GPT-4o2025.05		0.5573	0.5107	0.7085	0.5042	0.6722	0.6536	0.6472	0.6715	0.745	0.738	0.753	0.7238
GPT-4o2025.05		0.5564	0.5001	0.6932	0.4872	0.6703	0.6354	0.6332	0.6244	0.7386	0.7321	0.7353	0.7005
SylAVL-CoT (Gemini 2.0)2025.05		0.5395	0.4975	0.7016	0.4975	0.6561	0.6402	0.6467	0.6814	0.7358	0.73	0.7509	0.7241
Gemini 2.02025.05		0.5383	0.491	0.6979	0.4871	0.6538	0.6341	0.6506	0.6687	0.7314	0.7224	0.7468	0.7152
MBart-502025.05		0.4938	0.4891	0.6671	0.4547	0.5764	0.6339	0.6075	0.6123	0.7031	0.7258	0.7036	0.6925