Spoken Question Answering Retrieval on SLUE SQA-5
84.34R@10 (Q-C)BGE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| BGEParadigm=E2E, Question Type=Text, Context Type=Text2025.11 | 84.34 | 0 | 38.71 | 72.26 | 35.68 | 70.11 | 82.28 | |
| CLSRParadigm=E2E, Question Type=Speech, Context Type=Speech2025.11 | 74.43 | 16.69 | 30.65 | 62.19 | 29.89 | 62.18 | 73.05 | |
| Whisper+BGEParadigm=Pipeline, Question Type=Transcript, Context Type=Transcript2025.11 | 72.71 | 36.41 | 29.98 | 60.41 | 29.85 | 60.75 | 73.47 | |
| CLAPParadigm=E2E, Question Type=Text, Context Type=Speech2025.11 | 38.16 | — | 11.17 | 28.67 | 11.21 | 28.59 | 38.12 | |
| SpeechDPRParadigm=E2E, Question Type=Speech, Context Type=Speech2025.11 | 19.94 | — | — | — | — | — | — |