Quality Estimation Correlation on German MQM en-de (test)
0.708Pearson CorrelationCOMET-QE (PPbMQM)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COMET-QE (PPbMQM)Quality Score Bucket=< 0.8, Segments=2162026.03 | 0.708 | 0.606 | 0.439 | |
| COMET-QE (gold)Quality Score Bucket=< 0.8, Segments=2162026.03 | 0.692 | 0.565 | 0.402 | |
| COMET-QE (gold)Quality Score Bucket=0.0-1.0, Segments=11872026.03 | 0.503 | 0.325 | 0.243 | |
| COMET-QE (PPbMQM)Quality Score Bucket=0.0-1.0, Segments=11872026.03 | 0.447 | 0.188 | 0.137 | |
| COMET-QE (gold)Quality Score Bucket=0.8-0.9, Segments=1452026.03 | 0.055 | 0.004 | 0.007 | |
| COMET-QE (gold)Quality Score Bucket=0.9-1.0, Segments=7962026.03 | 0.041 | 0.012 | 0.004 | |
| COMET-QE (PPbMQM)Quality Score Bucket=0.8-0.9, Segments=1452026.03 | -0.034 | -0.047 | -0.032 | |
| COMET-QE (PPbMQM)Quality Score Bucket=0.9-1.0, Segments=7962026.03 | -0.135 | -0.19 | -0.131 |