Overall Performance on Must-C & Spoken-SQuAD
1.1418Normalized Averagecontr-cos-all + giga
Evaluation Results
| Method | Links | |
|---|---|---|
| contr-cos-all + gigaFT Data=100%2024.12 | 1.1418 | |
| contr-cos-all + asr + gigaFT Data=100%2024.12 | 1.1266 | |
| contr-cos-all + asrFT Data=100%2024.12 | 1.0657 | |
| contr-cos-all + asr + gigaFT Data=10%2024.12 | 1.0215 | |
| ASR pretrainFT Data=100%2024.12 | 1.0024 | |
| SpecializedFT Data=N/A2024.12 | 1 | |
| ASR pretrain + gigaFT Data=100%2024.12 | 0.9977 | |
| contr-cos-allFT Data=100%2024.12 | 0.9906 | |
| contr-cos-all + gigaFT Data=10%2024.12 | 0.9712 | |
| contr-cos-all + asrFT Data=10%2024.12 | 0.7817 | |
| ASR pretrain + gigaFT Data=10%2024.12 | 0.6937 | |
| contr-cos-allFT Data=10%2024.12 | 0.6739 | |
| ASR pretrainFT Data=10%2024.12 | 0.3993 | |
| Qwen2-Audio-7bFT Data=N/A2024.12 | 0.1079 | |
| BLSP-1slm-7bFT Data=N/A2024.12 | -0.9672 |