Contrastive Alignment on Must-C (test)
1.37Cosine SimilarityASR pretrain
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ASR pretrainFT Data=10%2024.12 | 1.37 | 1.3 | |
| ASR pretrain + gigaFT Data=10%2024.12 | 1.37 | 1.31 | |
| ASR pretrainFT Data=100%2024.12 | 1.37 | 1.22 | |
| ASR pretrain + gigaFT Data=100%2024.12 | 1.37 | 1.23 | |
| ASR pretrainFT Data=10%, Giga Dataset=false2024.12 | 1.37 | 1.3 | |
| ASR pretrainFT Data=10%, Giga Dataset=true2024.12 | 1.37 | 1.31 | |
| ASR pretrainFT Data=100%, Giga Dataset=false2024.12 | 1.37 | 1.22 | |
| ASR pretrainFT Data=100%, Giga Dataset=true2024.12 | 1.37 | 1.23 | |
| contr-wasser-all + asrFT Data=100%, Giga Dataset=false2024.12 | 1.33 | 0.93 | |
| contr-cos-allFT Data=100%2024.12 | 1.25 | 1.02 | |
| contr-cos-allFT Data=100%, Giga Dataset=false2024.12 | 1.25 | 1.02 | |
| contr-wasser-allFT Data=100%, Giga Dataset=true2024.12 | 1.25 | 0.87 | |
| contr-wasser-allFT Data=100%, Giga Dataset=false2024.12 | 1.24 | 0.91 | |
| contr-cos-all + asrFT Data=100%2024.12 | 1.19 | 1.03 | |
| contr-cos-all + asrFT Data=100%, Giga Dataset=false2024.12 | 1.19 | 1.03 | |
| contr-wasser-all + asrFT Data=100%, Giga Dataset=true2024.12 | 1.11 | 0.47 | |
| contr-cos-all + gigaFT Data=100%2024.12 | 1.1 | 0.83 | |
| contr-cos-all + asr + gigaFT Data=100%2024.12 | 1.1 | 0.79 | |
| contr-cos-allFT Data=100%, Giga Dataset=true2024.12 | 1.1 | 0.83 | |
| contr-cos-all + asrFT Data=100%, Giga Dataset=true2024.12 | 1.1 | 0.79 | |
| contr-wasser-allFT Data=10%, Giga Dataset=true2024.12 | 1.09 | 0.6 | |
| contr-wasser-all + asrFT Data=10%, Giga Dataset=false2024.12 | 1.09 | 0.66 | |
| contr-cos-allFT Data=10%2024.12 | 1.08 | 0.91 | |
| contr-cos-all + asrFT Data=10%2024.12 | 1.08 | 0.91 | |
| contr-wasser-embFT Data=10%, Giga Dataset=false2024.12 | 1.08 | 0.62 | |
| contr-cos-allFT Data=10%, Giga Dataset=false2024.12 | 1.08 | 0.91 | |
| contr-cos-all + asrFT Data=10%, Giga Dataset=false2024.12 | 1.08 | 0.91 | |
| contr-wasser-allFT Data=10%, Giga Dataset=false2024.12 | 1.07 | 0.64 | |
| contr-cos-all + gigaFT Data=10%2024.12 | 1.06 | 0.71 | |
| contr-wasser-embFT Data=10%, Giga Dataset=true2024.12 | 1.06 | 0.58 | |
| contr-cos-allFT Data=10%, Giga Dataset=true2024.12 | 1.06 | 0.71 | |
| contr-wasser-all + asrFT Data=10%, Giga Dataset=true2024.12 | 1.03 | 0.3 | |
| contr-cos-all + asr + gigaFT Data=10%2024.12 | 0.98 | 0.65 | |
| contr-cos-all + asrFT Data=10%, Giga Dataset=true2024.12 | 0.98 | 0.65 | |
| contr-cos-embFT Data=10%, Giga Dataset=false2024.12 | 0.97 | 0.72 | |
| contr-cos-embFT Data=10%, Giga Dataset=true2024.12 | 0.97 | 0.47 |