List your company

Plausibility Analysis on MLQE-PE v1 (test)

0.67EN-DE src AUCAttention (best head)
0.50360.54680.590.6332Apr 22, 2022

Evaluation results

MethodLinks
Attention (best head)Base Model=XLM-R-base, Training Samples=4,200, supervised=true2022.040.670.670.70.650.70.70.70.690.730.750.670.60.670.66
Gradient L2Base Model=XLM-R-base, Training Samples=4,2002022.040.640.650.650.490.670.610.680.550.720.680.650.540.670.59
Attention (SMaT)Base Model=XLM-R-base, Training Samples=4,2002022.040.640.650.680.520.660.640.660.540.710.70.610.540.660.6
Attention (best layer)Base Model=XLM-R-base, Training Samples=4,200, supervised=true2022.040.640.650.690.640.640.680.680.680.710.760.640.590.650.65
Attention (all layers)Base Model=XLM-R-base, Training Samples=4,2002022.040.60.630.680.520.60.610.580.550.660.70.620.550.620.59
Integrated GradientsBase Model=XLM-R-base, Training Samples=4,2002022.040.590.60.630.490.60.520.640.480.640.590.60.510.620.53
Gradient x InputBase Model=XLM-R-base, Training Samples=4,2002022.040.580.60.610.510.60.540.610.490.640.590.580.510.610.54
Attention (last layer)Base Model=XLM-R-base, Training Samples=4,2002022.040.510.490.610.490.510.50.550.480.520.570.560.50.540.5