Speech Question Answering on LibriSQA Part II 1.0
82.6AccuracyQwen3-4B-Instruct-2507 + LoRA (B)
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-4B-Instruct-2507 + LoRA (B)Model Category=Text-only Models, LoRA=B2026.07 | 82.6 | |
| SpeechMapper + LoRA (C) setup 1Model Category=Multimodally Trained Models, LoRA=C, Setup=12026.07 | 82.5 | |
| SpeechMapper + LoRA (C) setup 2Model Category=Multimodally Trained Models, LoRA=C, Setup=22026.07 | 80.2 | |
| SpeechMapper (A)Model Category=SFM and Projector-only Model, Setup=A2026.07 | 72.1 | |
| Llama-3.1-8B-InstructModel Category=Text-only Models, Zero-shot LLM=true2026.07 | 70.8 | |
| Qwen3-4B-Instruct-2507Model Category=Text-only Models, Zero-shot LLM=true2026.07 | 70.2 | |
| BEST-IWSLT25-IFModel Category=Multimodally Trained Models2026.07 | 63 |