Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Machine Translation Meta-evaluation research benchmarks · SOTA2 Research

Machine Translation Meta-evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

WMT Metrics Shared Task Segment-level 2023 (Primary submissions)

XCOMET-Ensemble

0.697Avg Correlation

33

Feb 26, 2026

80.4Meta Score

30

Feb 26, 2026

80.4Meta Score

30

Feb 26, 2026

WMT MQM (En-De, En-Es, Ja-Zh) 24

87.9SPA

28

Feb 26, 2026

0.572Acc*Eq

17

May 12, 2026

57.3Acc*Eq

17

May 12, 2026

56.8Acc*Eq

17

May 12, 2026

61.4Acc*Eq

17

May 12, 2026

WMT En-De Metrics Shared Task (Segment-Level) 2023 (test)

57.4Accuracy (Test)

6

Feb 26, 2026

WMT En-De Metrics Shared Task (System-Level) 2023 (test)

98.5Accuracy

6

Feb 26, 2026

WMT Zh-En (subset of 600 samples) 2022

0.46Kendall Correlation

2

Feb 26, 2026

Popular datasets

WMT MENT WMT Metrics Shared Task

Follow for updates

Join SOTA2 Contact