Speech Translation Evaluation Correlation on Europarl-ST
0.9983Pearson Correlationwhspr-mdld
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| whspr-mdldASR Source=owsmST2025.11 | 0.9983 | 86.44 | |
| whspr-nllbASR Source=owsmST2025.11 | 0.9982 | 85.76 | |
| smlss-mdldASR Source=owsmST2025.11 | 0.9979 | 83.52 | |
| whspr-mdldASR Source=owsm+mdld2025.11 | 0.9978 | 83.75 | |
| smlss-nllbASR Source=owsmST2025.11 | 0.9978 | 82.73 | |
| whspr-nllbASR Source=owsm+mdld2025.11 | 0.9977 | 82.98 | |
| whspr-mdldASR Source=smlssST2025.11 | 0.9973 | 83.03 | |
| smlss-mdldASR Source=owsm+mdld2025.11 | 0.9972 | 79.77 | |
| whspr-nllbASR Source=smlssST2025.11 | 0.9971 | 82.31 | |
| smlss-nllbASR Source=owsm+mdld2025.11 | 0.9971 | 79.09 | |
| smlss-mdldASR Source=smlssST2025.11 | 0.9968 | 80.24 | |
| whspr-mdldASR Source=average2025.11 | 0.9967 | 81.46 | |
| smlss-nllbASR Source=smlssST2025.11 | 0.9967 | 79.61 | |
| whspr-nllbASR Source=average2025.11 | 0.9966 | 80.66 | |
| BTmdld*ASR Source=owsmST2025.11 | 0.9965 | 73.02 | |
| BTmdld*ASR Source=owsm+mdld2025.11 | 0.9964 | 73.54 | |
| smlss-mdldASR Source=average2025.11 | 0.9962 | 78.2 | |
| BTnllb*ASR Source=owsmST2025.11 | 0.9961 | 69.42 | |
| smlss-nllbASR Source=average2025.11 | 0.996 | 77.53 | |
| BTmdld*ASR Source=smlssST2025.11 | 0.9958 | 74 | |
| BTnllb*ASR Source=owsm+mdld2025.11 | 0.9958 | 69.48 | |
| whspr-mdldASR Source=whsprST2025.11 | 0.9957 | 79.48 | |
| whspr-mdldASR Source=whspr+mdld2025.11 | 0.9957 | 79.54 | |
| whspr-mdldASR Source=smlss+mdld2025.11 | 0.9957 | 79.61 | |
| whspr-nllbASR Source=whspr+mdld2025.11 | 0.9956 | 78.73 | |
| owsm-mdldASR Source=owsmST2025.11 | 0.9956 | 65.59 | |
| whspr-nllbASR Source=whsprST2025.11 | 0.9955 | 78.6 | |
| whspr-nllbASR Source=smlss+mdld2025.11 | 0.9955 | 78.75 | |
| owsm-nllbASR Source=owsmST2025.11 | 0.9954 | 64.37 | |
| smlss-mdldASR Source=whsprST2025.11 | 0.9952 | 77.22 | |
| BTnllb*ASR Source=smlssST2025.11 | 0.9952 | 70.27 | |
| smlss-nllbASR Source=whsprST2025.11 | 0.9951 | 76.61 | |
| BTmdld*ASR Source=average2025.11 | 0.9951 | 72.39 | |
| smlss-mdldASR Source=whspr+mdld2025.11 | 0.9949 | 75.44 | |
| smlss-mdldASR Source=smlss+mdld2025.11 | 0.9949 | 76.09 | |
| smlss-nllbASR Source=smlss+mdld2025.11 | 0.9948 | 75.39 | |
| smlss-nllbASR Source=whspr+mdld2025.11 | 0.9947 | 74.78 | |
| BTmdld*ASR Source=whsprST2025.11 | 0.9944 | 73.39 | |
| BTnllb*ASR Source=average2025.11 | 0.9944 | 68.41 | |
| owsm-mdldASR Source=owsm+mdld2025.11 | 0.994 | 56.32 | |
| owsm-nllbASR Source=owsm+mdld2025.11 | 0.9939 | 55.49 | |
| BTmdld*ASR Source=whspr+mdld2025.11 | 0.9939 | 70.71 | |
| BTmdld*ASR Source=smlss+mdld2025.11 | 0.9938 | 70.72 | |
| BTnllb*ASR Source=whsprST2025.11 | 0.9936 | 69.84 | |
| BTnllb*ASR Source=whspr+mdld2025.11 | 0.993 | 66.36 | |
| BTnllb*ASR Source=smlss+mdld2025.11 | 0.9929 | 66.29 | |
| owsm-mdldASR Source=smlssST2025.11 | 0.991 | 44.39 | |
| owsm-nllbASR Source=smlssST2025.11 | 0.9909 | 43.71 | |
| owsm-mdldASR Source=average2025.11 | 0.9896 | 41.34 | |
| owsm-nllbASR Source=average2025.11 | 0.9895 | 40.6 | |
| COMET-ref*ASR Source=owsm+mdld2025.11 | 0.9894 | — | |
| owsm-mdldASR Source=whspr+mdld2025.11 | 0.9874 | 39.8 | |
| owsm-nllbASR Source=whspr+mdld2025.11 | 0.9873 | 39.31 | |
| COMET-ref*ASR Source=smlssST2025.11 | 0.9873 | — | |
| shuff*ASR Source=owsmST2025.11 | 0.9872 | — | |
| owsm-mdldASR Source=smlss+mdld2025.11 | 0.9869 | 38.16 | |
| owsm-nllbASR Source=smlss+mdld2025.11 | 0.9868 | 37.5 | |
| shuff*ASR Source=owsm+mdld2025.11 | 0.9863 | — | |
| COMET-ref*ASR Source=average2025.11 | 0.9857 | — | |
| COMET-ref*ASR Source=owsmST2025.11 | 0.9851 | — | |
| COMET-ref*ASR Source=whsprST2025.11 | 0.9842 | — | |
| COMET-ref*ASR Source=whspr+mdld2025.11 | 0.9841 | — | |
| COMET-ref*ASR Source=smlss+mdld2025.11 | 0.984 | — | |
| shuff*ASR Source=smlssST2025.11 | 0.9838 | — | |
| owsm-mdldASR Source=whsprST2025.11 | 0.983 | 19.32 | |
| owsm-nllbASR Source=whsprST2025.11 | 0.9828 | 18.56 | |
| shuff*ASR Source=average2025.11 | 0.9824 | — | |
| shuff*ASR Source=whspr+mdld2025.11 | 0.9791 | — | |
| shuff*ASR Source=whsprST2025.11 | 0.9789 | — | |
| shuff*ASR Source=smlss+mdld2025.11 | 0.9788 | — |