Speech Question Answering on MuST-C (test)
76.11EMcontr-cos-all + asr
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| contr-cos-all + asrFT Data=100%, Giga Dataset=true2024.12 | 76.11 | 84.94 | |
| contr-wasser-allFT Data=100%, Giga Dataset=true2024.12 | 75.49 | 84.52 | |
| contr-cos-allFT Data=100%, Giga Dataset=true2024.12 | 75.12 | 84.67 | |
| contr-wasser-all + asrFT Data=100%, Giga Dataset=true2024.12 | 74.27 | 84.39 | |
| contr-wasser-all + asrFT Data=100%, Giga Dataset=false2024.12 | 73.13 | 83.24 | |
| contr-cos-all + asrFT Data=100%, Giga Dataset=false2024.12 | 72.4 | 82.47 | |
| ASR pretrainFT Data=100%, Giga Dataset=true2024.12 | 72.25 | 82.56 | |
| contr-cos-all + asrFT Data=10%, Giga Dataset=true2024.12 | 72.16 | 82.52 | |
| contr-cos-allFT Data=100%, Giga Dataset=false2024.12 | 71.71 | 82.5 | |
| contr-wasser-all + asrFT Data=10%, Giga Dataset=true2024.12 | 70.47 | 82.21 | |
| ASR pretrainFT Data=100%, Giga Dataset=false2024.12 | 69.87 | 80.92 | |
| contr-wasser-allFT Data=100%, Giga Dataset=false2024.12 | 68.65 | 80.21 | |
| contr-wasser-allFT Data=10%, Giga Dataset=true2024.12 | 68.13 | 80.29 | |
| contr-wasser-all + asrFT Data=10%, Giga Dataset=false2024.12 | 66.29 | 77.19 | |
| contr-cos-allFT Data=10%, Giga Dataset=true2024.12 | 65.45 | 79.12 | |
| SpecializedFT Data=N/A, Giga Dataset=false2024.12 | 64.19 | 77.1 | |
| contr-wasser-allFT Data=10%, Giga Dataset=false2024.12 | 64.06 | 77.22 | |
| contr-cos-embFT Data=10%, Giga Dataset=true2024.12 | 63.94 | 76.6 | |
| contr-cos-all + asrFT Data=10%, Giga Dataset=false2024.12 | 63.81 | 76.12 | |
| ASR pretrainFT Data=10%, Giga Dataset=true2024.12 | 62.23 | 73.17 | |
| contr-cos-allFT Data=10%, Giga Dataset=false2024.12 | 60.48 | 73.9 | |
| contr-wasser-embFT Data=10%, Giga Dataset=true2024.12 | 58.05 | 71.09 | |
| contr-cos-embFT Data=10%, Giga Dataset=false2024.12 | 54.86 | 68.49 | |
| contr-wasser-embFT Data=10%, Giga Dataset=false2024.12 | 54.64 | 67.83 | |
| ASR pretrainFT Data=10%, Giga Dataset=false2024.12 | 49.48 | 63.36 | |
| Qwen2-Audio-7bFT Data=N/A, Giga Dataset=false2024.12 | 27.79 | 46.75 | |
| BLSP-lslm-7bFT Data=N/A, Giga Dataset=false2024.12 | 5.6 | 21.82 |