Synthetic Metric Validation on IWSLT Bemba-English (JHU@iwslt25) 2025 (test)
13.582Mean Score (mu)ASRmms
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ASRmmsTarget Metric=MetricX2025.11 | 13.582 | 0.8016 | 6.112 | |
| shufTarget Metric=MetricX2025.11 | 10.344 | 0.7641 | 3.481 | |
| BTnllb600mAdaTarget Metric=MetricX2025.11 | 7.985 | 0.9269 | 1.402 | |
| ref (standard)Target Metric=MetricX2025.11 | 7.911 | — | — | |
| ASRwhsprAdaTarget Metric=MetricX2025.11 | 7.859 | 0.9649 | 0.957 | |
| BThlsnkTarget Metric=MetricX2025.11 | 7.719 | 0.9135 | 1.559 | |
| ASRmmsTarget Metric=COMET2025.11 | 0.7293 | 0.9925 | 0.0187 | |
| BTnllb600mAdaTarget Metric=COMET2025.11 | 0.7197 | 0.9934 | 0.0142 | |
| BThlsnkTarget Metric=COMET2025.11 | 0.7191 | 0.9922 | 0.0154 | |
| ref (standard)Target Metric=COMET2025.11 | 0.7185 | — | — | |
| ASRwhsprAdaTarget Metric=COMET2025.11 | 0.7185 | 0.9974 | 0.0089 | |
| shufTarget Metric=COMET2025.11 | 0.7171 | 0.9898 | 0.0175 |