Audio Understanding on Big Bench Audio
77.2Audio AccuracyDuplexOmni
Evaluation results
| Method | Links | |
|---|---|---|
| DuplexOmniEvaluation Mode=real-time mode, Latency (s)=0.5062026.06 | 77.2 | |
| Gemini-3.1-Flash-LiteEvaluation Mode=real-time mode2026.06 | 58.9 | |
| Gemini-3.1-Flash-LiveEvaluation Mode=real-time mode, Latency (s)=2.572026.06 | 57.9 | |
| DoubaoEvaluation Mode=real-time mode, Latency (s)=1.822026.06 | 47.9 | |
| MiniCPM-o 4.5Evaluation Mode=real-time mode, Latency (s)=0.5022026.06 | 36 | |
| Qwen3.5-Omni-Realtime-FlashEvaluation Mode=real-time mode, Latency (s)=1.252026.06 | 35 | |
| Qwen3-Omni-Realtime-FlashEvaluation Mode=real-time mode, Latency (s)=1.282026.06 | 32.1 |