Spoken Question Answering on LlamaQ, WebQ, and TriviaQA Aggregate
46.2Avg Acc (S->S)Lychee-FD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Lychee-FDType=Native2026.07 | 46.2 | 51.5 | 100 | |
| StepAudio-2-miniType=Half-duplex2026.07 | 40.9 | 51.3 | — | |
| Lychee-FD (w/o Sem-Channel)Type=Native2026.07 | 40.8 | 45.9 | 99.6 | |
| Fun-Audio-ChatType=Native2026.07 | 38.8 | 42.7 | 99.9 | |
| SALMONN-omniType=Native2026.07 | 38 | 44.5 | 99.9 | |
| VITA 1.5Type=System-level2026.07 | 35.4 | 50.8 | 100 | |
| Freeze-OmniType=System-level2026.07 | 33.4 | 44.6 | 99.6 | |
| MoshiType=Native2026.07 | 30.5 | 35.5 | 93.8 | |
| Lychee-FD (w/o Param-Sep)Type=Native2026.07 | 27.6 | 46.1 | 98.5 | |
| FLM-audioType=Native2026.07 | 20.5 | 22.4 | 99.5 | |
| dGSLMType=Native2026.07 | 0.6 | — | 100 |