Synthetic Metric Validation on IWSLT Bemba-English (Prototype) 2025 (test)
0.6945Mean Error (mu)shuf
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| shufTarget Metric=COMET2025.11 | 0.6945 | 0.988 | 0.0186 | |
| ref (standard)Target Metric=COMET2025.11 | 0.6961 | — | — | |
| ASRwhsprAdaTarget Metric=COMET2025.11 | 0.6962 | 0.997 | 0.0092 | |
| BThlsnkTarget Metric=COMET2025.11 | 0.6966 | 0.9914 | 0.0158 | |
| BTnllb600mAdaTarget Metric=COMET2025.11 | 0.6973 | 0.9927 | 0.0145 | |
| ASRmmsTarget Metric=COMET2025.11 | 0.7076 | 0.9918 | 0.0194 | |
| BThlsnkTarget Metric=MetricX2025.11 | 8.215 | 0.9149 | 1.534 | |
| ASRwhsprAdaTarget Metric=MetricX2025.11 | 8.398 | 0.9659 | 0.938 | |
| ref (standard)Target Metric=MetricX2025.11 | 8.437 | — | — | |
| BTnllb600mAdaTarget Metric=MetricX2025.11 | 8.485 | 0.9287 | 1.365 | |
| shufTarget Metric=MetricX2025.11 | 10.67 | 0.7736 | 3.273 | |
| ASRmmsTarget Metric=MetricX2025.11 | 13.691 | 0.7982 | 5.726 |