Metric Correlation Analysis on MuST-C (test)
94.62whspr+mdldwhspr-mdld
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| whspr-mdldASR_source=automatic re-segmented, segmentation=shas+XLR-SimAlign2025.11 | 94.62 | 98.58 | 95.92 | 96.59 | 96.4 | 96.42 | |
| whspr-nllbASR_source=automatic re-segmented, segmentation=shas+XLR-SimAlign2025.11 | 94.48 | 98.51 | 95.84 | 96.49 | 96.31 | 96.32 | |
| owsm-mdldASR_source=automatic re-segmented, segmentation=shas+XLR-SimAlign2025.11 | 93.97 | 98.02 | 93.71 | 95.86 | 95.62 | 95.44 | |
| owsm-nllbASR_source=automatic re-segmented, segmentation=shas+XLR-SimAlign2025.11 | 93.77 | 97.89 | 93.48 | 95.67 | 95.38 | 95.24 | |
| MetricX-ref*source=reference transcript2025.11 | 93.26 | 96.15 | 93.84 | 93.34 | 93.88 | 94.09 | |
| BTmdld*ASR_source=Back-translated2025.11 | 92.77 | 97.54 | 93.92 | 94.32 | 94.28 | 94.57 | |
| BTnllb*ASR_source=Back-translated2025.11 | 92.71 | 97.46 | 93.82 | 94.31 | 94.24 | 94.51 | |
| smlss-mdldASR_source=automatic re-segmented, segmentation=shas+XLR-SimAlign2025.11 | 79.27 | 94.13 | 83.56 | 84.58 | 83.85 | 85.08 | |
| smlss-nllbASR_source=automatic re-segmented, segmentation=shas+XLR-SimAlign2025.11 | 78.89 | 94 | 83.12 | 84.15 | 83.47 | 84.73 | |
| shuff*source_type=shuffled source2025.11 | 51.14 | 71.02 | 55.36 | 57.79 | 56.93 | 58.45 |