List your company

Metrics correlation with human judgment on WebNLG challenge 2017

0.9Spearman Correlation (rho)MoverScore
0.09920.30710.5150.7229Mar 17, 2022

Evaluation results

MethodLinks
MoverScoreSystem=vietnam2022.030.90.780.73
METEORSystem=vietnam2022.030.870.90.72
RoMeSystem=vietnam2022.030.840.890.83
BERTScoreSystem=vietnam2022.030.810.760.7
BLEUSystem=vietnam2022.030.730.80.62
RoMeSystem=ADAPT2022.030.720.70.51
MoverScoreSystem=ADAPT2022.030.680.730.49
RoMeSystem=tilburg-nmt2022.030.640.680.5
MoverScoreSystem=tilburg-pipe2022.030.620.50.35
BERTScoreSystem=ADAPT2022.030.610.720.5
MoverScoreSystem=Baseline2022.030.590.610.43
RoMeSystem=Pkuwriter2022.030.580.560.39
METEORSystem=ADAPT2022.030.570.580.41
MoverScoreSystem=Pkuwriter2022.030.570.560.39
BERTScoreSystem=tilburg-pipe2022.030.530.480.33
RoMeSystem=Baseline2022.030.530.530.37
METEORSystem=tilburg-pipe2022.030.520.430.3
RoMeSystem=tilburg-smt2022.030.50.510.36
METEORSystem=Baseline2022.030.490.490.33
BERTScoreSystem=Baseline2022.030.490.50.35
MoverScoreSystem=tilburg-nmt2022.030.490.50.36
BERTScoreSystem=Pkuwriter2022.030.480.530.38
METEORSystem=Pkuwriter2022.030.470.470.31
RoMeSystem=melbourne2022.030.440.50.35
RoMeSystem=upf-forge2022.030.420.420.3
MoverScoreSystem=melbourne2022.030.40.390.28
MoverScoreSystem=tilburg-smt2022.030.40.380.27
BLEUSystem=ADAPT2022.030.380.390.27
BLEUSystem=tilburg-pipe2022.030.380.410.3
BERTScoreSystem=tilburg-nmt2022.030.380.390.3
RoMeSystem=tilburg-pipe2022.030.380.420.27
BLEUSystem=Pkuwriter2022.030.370.380.28
BLEUSystem=Baseline2022.030.350.420.26
METEORSystem=melbourne2022.030.350.350.24
BERTScoreSystem=melbourne2022.030.330.330.26
BERTScoreSystem=tilburg-smt2022.030.330.30.25
BLEUSystem=melbourne2022.030.320.310.21
MoverScoreSystem=upf-forge2022.030.270.270.18
METEORSystem=tilburg-nmt2022.030.260.260.18
BERTScoreSystem=upf-forge2022.030.260.250.19
BLEUSystem=tilburg-nmt2022.030.250.20.13
BLEUSystem=tilburg-smt2022.030.250.20.13
METEORSystem=tilburg-smt2022.030.210.190.13
BLEUSystem=upf-forge2022.030.140.130.08
METEORSystem=upf-forge2022.030.130.110.08