Machine Translation on NLLB 53 languages subset (test) benchmark leaderboard · SOTA2 Research

Machine Translation on NLLB 53 languages subset (test)

45.41Score (High->High)54.5B MOE model

Evaluation Results

Method	Links
54.5B MOE model2022.12		45.41	38.98	31.89	39.72	35.4	28.83	37.29	33.23	26.95	36.81
Fixed per layer (lang-pair)2022.12		45.37	39.06	31.79	39.2	35.03	28.47	37.05	33.16	26.63	36.59
Fixed per layer (lang)2022.12		45.35	39.1	31.82	39.18	35.1	28.51	37.02	33.19	26.62	36.61
3.3B dense model2022.12		44.18	38.3	31.45	38.24	34.6	27.93	35.93	32.02	26.47	35.81
Fixed per layer (global)2022.12		43.2	37.6	31.68	37.37	33.94	28.4	35.38	31.97	26.84	35.34