Quality Estimation Correlation on English MQM en-de (test)
0.523Pearson ρCOMET-QE (PPbMQM)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COMET-QE (PPbMQM)Quality Score Bucket=< 0.8, Segments=13042026.03 | 0.523 | 0.526 | 0.37 | |
| COMET-QE (PPbMQM)Quality Score Bucket=0.0-1.0, Segments=48062026.03 | 0.513 | 0.381 | 0.272 | |
| COMET-QE (gold)Quality Score Bucket=0.0-1.0, Segments=48062026.03 | 0.47 | 0.41 | 0.29 | |
| COMET-QE (gold)Quality Score Bucket=< 0.8, Segments=13042026.03 | 0.434 | 0.425 | 0.294 | |
| COMET-QE (gold)Quality Score Bucket=0.8-0.9, Segments=9102026.03 | 0.063 | 0.077 | 0.053 | |
| COMET-QE (gold)Quality Score Bucket=0.9-1.0, Segments=25922026.03 | 0.019 | 0.02 | 0.016 | |
| COMET-QE (PPbMQM)Quality Score Bucket=0.8-0.9, Segments=9102026.03 | -0.005 | 0.016 | 0.011 | |
| COMET-QE (PPbMQM)Quality Score Bucket=0.9-1.0, Segments=25922026.03 | -0.157 | -0.128 | -0.085 |