Spoken Question Answering on WebQuestions (speech score, text score)
40.8Text ScoreFreeze-Omni
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Freeze-OmniBackbone LLM=Qwen2-7B-Instruct, Full-Duplex=true2026.05 | 40.8 | 27.9 | |
| GLM-4-VoiceBackbone LLM=GLM-4-9B-Base, Full-Duplex=false2026.05 | 32.2 | 15.9 | |
| CF-DuplexBackbone LLM=Qwen3-1.7B, Full-Duplex=true2026.05 | 30.3 | 28 | |
| MoshiBackbone LLM=Helium (7B), Full-Duplex=true2026.05 | 23.4 | 22.1 | |
| XA-DuplexBackbone LLM=Qwen3-1.7B, Full-Duplex=true2026.05 | 18.7 | 18.4 | |
| Speech-GPTBackbone LLM=LLaMA-13B, Full-Duplex=false2026.05 | 16.5 | — | |
| SALM-DuplexBackbone LLM=TinyLlama-1.1B-chat, Full-Duplex=true2026.05 | — | 25 |