Spoken Question Answering on VERA
18.54AccuracySerial
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Serialthinking_mode=Think, variant=upper bound2026.01 | 18.54 | 151,000 | 212,000 | |
| PredGenthinking_mode=Think2026.01 | 8.69 | 47,000 | 106,000 | |
| LTS-VADthinking_mode=Think2026.01 | 8.69 | 47,000 | 103,000 | |
| LTS-VoiceAgent2026.01 | 6.88 | 230 | 415 | |
| Serialthinking_mode=No-think2026.01 | 4.36 | 1,205 | 4,782 | |
| PredGenthinking_mode=No-think2026.01 | 4.34 | 247 | 298 | |
| LTS-VADthinking_mode=No-think2026.01 | 3.98 | 244 | 380 | |
| Qwen2.5-Omniarchitecture=E2E2026.01 | 1.44 | 339.9 | 985.95 |