Synthetic Metric Validation on IWSLT Bemba-English KIT 2025 (test)
0.7152Metric Mushuf
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| shufTarget Metric=COMET2025.11 | 0.7152 | 0.9877 | 0.0181 | |
| ref (standard)Target Metric=COMET2025.11 | 0.7171 | — | — | |
| ASRwhsprAdaTarget Metric=COMET2025.11 | 0.7171 | 0.9968 | 0.0092 | |
| BThlsnkTarget Metric=COMET2025.11 | 0.7175 | 0.9907 | 0.0157 | |
| BTnllb600mAdaTarget Metric=COMET2025.11 | 0.7182 | 0.9921 | 0.0144 | |
| ASRmmsTarget Metric=COMET2025.11 | 0.7286 | 0.9906 | 0.0195 | |
| BThlsnkTarget Metric=MetricX2025.11 | 7.562 | 0.8958 | 1.551 | |
| ASRwhsprAdaTarget Metric=MetricX2025.11 | 7.803 | 0.9575 | 0.956 | |
| ref (standard)Target Metric=MetricX2025.11 | 7.831 | — | — | |
| BTnllb600mAdaTarget Metric=MetricX2025.11 | 7.872 | 0.9129 | 1.385 | |
| shufTarget Metric=MetricX2025.11 | 10.155 | 0.7179 | 3.397 | |
| ASRmmsTarget Metric=MetricX2025.11 | 13.397 | 0.76 | 5.979 |