Speech Synthesis on Minimax Multilingual (test)

0.73Chinese WER (%)Fish Audio S2

Updated 5mo ago

Evaluation results

Method
Fish Audio S22026.03	0.73	3.5	0.75	30.67	0.805	0.816	2.84	0.798	0.99	0.73	1.62	0.797	3.33	0.819	3.05	0.698	0.55	0.767	5.74	0.795	14.64	0.821	1.46	0.763	1.27	0.747	2.76	0.796	1.18	0.817	1.26	0.819	1.14	0.781	10.74	0.733	2.4	0.79	0.91	0.776	4.23	0.786	0.87	0.835	2.3	0.747	7.41	0.74
Fish Audio S22026.06	0.73	3.5	—	30.67	—	—	2.84	—	0.99	—	1.62	—	3.33	—	3.05	—	0.55	—	5.74	—	14.64	—	1.46	—	1.27	—	2.76	—	1.18	—	1.26	—	1.14	—	10.74	—	2.4	—	0.91	—	4.23	—	0.87	—	2.3	—	7.41	—
Qwen3-TTS2026.06	0.93	—	—	—	—	—	—	—	—	—	0.93	—	—	—	2.86	—	1.24	—	—	—	—	—	—	—	0.95	—	3.82	—	1.76	—	—	—	1.53	—	—	—	3.21	—	1.13	—	—	—	—	—	—	—	—	—
Fish Audio S12026.03	0.98	6.42	0.713	48.8	0.773	0.777	18.02	0.733	2.27	0.701	2.37	0.785	10	0.78	5.7	0.602	0.65	0.719	19.84	0.746	32.28	0.792	8	0.696	1.87	0.714	3.45	0.78	1.99	0.747	3.41	0.794	1.94	0.756	19.49	0.739	5.25	0.764	1.78	0.753	96.75	0.691	2.26	0.786	14.49	0.653	78.13	0.664
VoxCPM22026.06	1.14	13.05	—	38.58	—	—	24.13	—	0.91	—	2.29	—	2.63	—	4.53	—	0.68	—	2.84	—	19.7	—	1.08	—	1.56	—	4.63	—	1.96	—	1.14	—	1.94	—	21.58	—	3.63	—	1.44	—	2.96	—	0.82	—	6.32	—	3.31	—
Minimax2026.06	2.25	1.67	—	34.11	—	—	3.88	—	1.14	—	2.16	—	4.67	—	4.1	—	1.91	—	2.02	—	6.96	—	1.24	—	1.54	—	3.52	—	1.75	—	1.42	—	1.88	—	2.88	—	4.28	—	1.03	—	2.7	—	1.52	—	1.08	—	0.88	—
MiniMax2026.03	2.252	1.665	0.736	34.111	0.778	0.78	3.875	0.796	1.143	0.738	2.164	0.756	4.666	0.835	4.099	0.628	1.906	0.733	2.016	0.826	6.962	0.818	1.237	0.729	1.543	0.699	3.519	0.776	1.747	0.776	1.415	0.802	1.877	0.805	2.878	0.809	4.281	0.761	1.029	0.762	2.701	0.8	1.52	0.779	1.082	0.73	0.88	0.743
ElevenLabs2026.03	16.026	1.666	0.706	51.513	0.67	0.677	2.108	0.685	0.803	0.68	2.339	0.613	2.964	0.759	5.216	0.535	0.572	0.614	0.991	0.733	5.827	0.73	1.059	0.66	1.743	0.579	10.646	0.738	1.865	0.7	0.766	0.729	1.331	0.711	1.347	0.699	3.878	0.676	1.084	0.615	73.936	0.588	0.699	0.596	0.997	0.647	73.415	0.369
ElevenLabs2026.06	16.03	1.67	—	51.51	—	—	2.11	—	0.8	—	2.34	—	2.96	—	5.22	—	0.57	—	0.99	—	5.83	—	1.06	—	1.74	—	10.65	—	1.87	—	0.77	—	1.33	—	1.35	—	3.88	—	1.08	—	73.94	—	0.7	—	1	—	73.42	—