List your company
ResearchFormerly WizWand

Automatic Speech Recognition on SAP rated (test)

13.38WERQwen3-ASR-1.7B
11.933221.699131.46541.2309May 4, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Qwen3-ASR-1.7BPromptable=No, Evaluation Mode=Zero-shot baseline2026.0513.38
Qwen3-Omni-30B‡Promptable=Yes, Evaluation Mode=Zero-shot baseline2026.0513.77
Voxtral-Small-24BPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0513.88
Cohere TranscribePromptable=No, Evaluation Mode=Zero-shot baseline2026.0514.48
Voxtral-Mini-3BPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0515.31
Phi-4 MultimodalPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0515.77
Parakeet-TDT-1.1BPromptable=No, Evaluation Mode=Zero-shot baseline2026.0515.85
Qwen3-Thinking-30BPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0516.5
Whisper-large-v3Promptable=No, Evaluation Mode=Zero-shot baseline2026.0517.1
MiniCPM-o 4.5Promptable=Yes, Evaluation Mode=Zero-shot baseline2026.0518.12
MiniCPM-o ThinkPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0518.41
Qwen2-Audio-7BPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0522.22
Ultravox-Nemo 12BPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0531.23
Gemma-4-4BPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0531.61
Gemma-4-2BPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0531.96
Gemma-4-4B ThinkPromptable=Yes, Evaluation Mode=Zero-shot baseline2026.0532.15
Wav2Vec2-RobustPromptable=No, Evaluation Mode=Zero-shot baseline2026.0532.64
Wav2Vec2Promptable=No, Evaluation Mode=Zero-shot baseline2026.0539.3
Audio Flamingo 3∗Promptable=Yes, Evaluation Mode=Zero-shot baseline2026.0549.55