Spoken Question Answering on TriviaQA (speech score, text score)
45.1Text ScoreFreeze-Omni
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Freeze-OmniBackbone LLM=Qwen2-7B-Instruct, Full-Duplex=true2026.05 | 45.1 | 28.5 | |
| GLM-4-VoiceBackbone LLM=GLM-4-9B-Base, Full-Duplex=false2026.05 | 39.1 | 26.5 | |
| MoshiBackbone LLM=Helium (7B), Full-Duplex=true2026.05 | 25.6 | 16.7 | |
| CF-DuplexBackbone LLM=Qwen3-1.7B, Full-Duplex=true2026.05 | 19.6 | 18.1 | |
| Speech-GPTBackbone LLM=LLaMA-13B, Full-Duplex=false2026.05 | 14.8 | — | |
| XA-DuplexBackbone LLM=Qwen3-1.7B, Full-Duplex=true2026.05 | 8.2 | 8 | |
| SALM-DuplexBackbone LLM=TinyLlama-1.1B-chat, Full-Duplex=true2026.05 | — | 16.9 |