Automatic Speech Recognition on KeSpeech
3.05CERFireRedASR2S LLM
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FireRedASR2S LLMModel Size=8B+, Inference Mode=Offline2026.04 | 3.05 | — | — | — | — | — | — | — | — | — | — | |
| FireRedASR-LLMModel Size=8B+ (↑)2026.04 | 3.53 | — | — | — | — | — | — | — | — | — | — | |
| FireRed-LLMParams=8.3B2026.05 | 3.58 | — | — | — | — | — | — | — | — | — | — | |
| FireRed-AEDParams=1.2B2026.05 | 3.97 | — | — | — | — | — | — | — | — | — | — | |
| Step-Audio2-miniModel Size=8B+ (↑)2026.04 | 3.98 | — | — | — | — | — | — | — | — | — | — | |
| Step-Audio2 MiniModel Size=8B+, Inference Mode=Offline2026.04 | 3.98 | — | — | — | — | — | — | — | — | — | — | |
| NIM4-ASRModel Size=2.3B, Inference Mode=Offline2026.04 | 4.4 | — | — | — | — | — | — | — | — | — | — | |
| OursModel Size=2.3B2026.04 | 4.56 | — | — | — | — | — | — | — | — | — | — | |
| FireRed-AED2026.01 | 4.85 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-ASR-1.7BModel Size=2.0B (↓)2026.04 | 4.98 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-ASR 1.7BModel Size=2.0B, Inference Mode=Offline2026.04 | 4.98 | — | — | — | — | — | — | — | — | — | — | |
| Dolphin-CN-Dialect-0.4BParams=0.4B2026.05 | 5.04 | — | — | — | — | — | — | — | — | — | — | |
| NIM4-ASRModel Size=2.3B, Inference Mode=Stream2026.04 | 5.08 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-ASR-1.7BParameters=1.7B2026.01 | 5.1 | — | — | — | — | — | — | — | — | — | — | |
| Doubao-ASR2026.01 | 5.27 | — | — | — | — | — | — | — | — | — | — | |
| ZipformerTraining Data=ASR+ST, Training Steps=320K, Decoding Strategy=Greedy2026.01 | 5.45 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-1.7BParams=1.7B2026.05 | 5.73 | — | — | — | — | — | — | — | — | — | — | |
| ZipformerTraining Data=ASR-only, Training Steps=312K, Decoding Strategy=Greedy2026.01 | 5.75 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-Omni-InstModel Size=30B-A3B (↑)2026.04 | 6 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-Omni InstructModel Size=30B-A3B, Inference Mode=Offline2026.04 | 6 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-0.6BParams=0.6B2026.05 | 7.07 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-ASR-0.6BParameters=0.6B2026.01 | 7.08 | — | — | — | — | — | — | — | — | — | — | |
| Fun-ASR-nanoModel Size=0.8B (↓)2026.04 | 7.18 | — | — | — | — | — | — | — | — | — | — | |
| Fun-ASR NanoModel Size=0.8B, Inference Mode=Offline2026.04 | 7.18 | — | — | — | — | — | — | — | — | — | — | |
| FunASR-Nano-2512Params=0.8B2026.05 | 7.85 | — | — | — | — | — | — | — | — | — | — | |
| GLM-ASRParams=1.5B2026.05 | 7.85 | — | — | — | — | — | — | — | — | — | — | |
| Dolphin-CN-Dialect-0.1BParams=0.1B2026.05 | 8.797 | — | — | — | — | — | — | — | — | — | — | |
| GLM-ASR-nanoModel Size=1.5B (↓)2026.04 | 9.59 | — | — | — | — | — | — | — | — | — | — | |
| GLM-ASR NanoModel Size=1.5B, Inference Mode=Offline2026.04 | 9.59 | — | — | — | — | — | — | — | — | — | — | |
| Paraformer2026.01 | 11.26 | — | — | — | — | — | — | — | — | — | — | |
| Paraformer zhParams=220M2026.05 | 14.46 | — | — | — | — | — | — | — | — | — | — | |
| SenseVoice-SParams=234M2026.05 | 17.84 | — | — | — | — | — | — | — | — | — | — | |
| Gemini-2.5-Pro2026.01 | 24.71 | — | — | — | — | — | — | — | — | — | — | |
| GPT-4o-Transcribe2026.01 | 26.87 | — | — | — | — | — | — | — | — | — | — | |
| Whisper-large-v32026.01 | 28.79 | — | — | — | — | — | — | — | — | — | — | |
| APdeeplin=-, ldeep=✓, FRR=14.30, Pre. GFLOPs=718.12, FLOPs Ratio=91.96, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.04 | — | — | — | — | — | — | — | — | — | — | 3.31 | |
| APdeeplin=-, ldeep=✓, FRR=33.29, Pre. GFLOPs=731.96, FLOPs Ratio=93.73, Setting=Conservative (τin=0.90, τdeep=0.80)2026.04 | — | — | — | — | — | — | — | — | — | — | 3.31 | |
| APinlin=✓, ldeep=-, FRR=78.64, Pre. GFLOPs=612.93, FLOPs Ratio=78.49, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.04 | — | — | — | — | — | — | — | — | — | — | 3.39 | |
| APinlin=✓, ldeep=-, FRR=93.56, Pre. GFLOPs=730.28, FLOPs Ratio=93.51, Setting=Conservative (τin=0.90, τdeep=0.80)2026.04 | — | — | — | — | — | — | — | — | — | — | 3.26 | |
| Baichuan-omniParameters=7B2024.10 | — | 2.8 | 6.4 | 7 | 7.7 | 6.1 | 5.8 | 9 | 8.3 | 7.2 | — | |
| DAPlin=✓, ldeep=✓, FRR=14.91, Pre. GFLOPs=566.30, FLOPs Ratio=72.52, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.04 | — | — | — | — | — | — | — | — | — | — | 3.44 | |
| DAPlin=✓, ldeep=✓, FRR=33.76, Pre. GFLOPs=686.39, FLOPs Ratio=87.89, Setting=Conservative (τin=0.90, τdeep=0.80)2026.04 | — | — | — | — | — | — | — | — | — | — | 3.29 | |
| Gemini-3.1 Pro2026.04 | — | — | — | — | — | — | — | — | — | — | 23.67 | |
| Qwen2-Audio-InstructParameters=7B2024.10 | — | 5.8 | 9.7 | 10.5 | 11 | 8.2 | 8.4 | 13.8 | 10.3 | 11.2 | — | |
| Qwen3.5-Omni-Flash2026.04 | — | — | — | — | — | — | — | — | — | — | 4.47 | |
| Qwen3.5-Omni-Plus2026.04 | — | — | — | — | — | — | — | — | — | — | 3.46 | |
| Vanillalin=-, ldeep=-, FRR=100.0, Pre. GFLOPs=780.94, FLOPs Ratio=100.0, Setting=N/A2026.04 | — | — | — | — | — | — | — | — | — | — | 3.28 | |
| Whisper-large-v3Parameters=1.55B2024.10 | — | 18.7 | 44.8 | 52.9 | 54.8 | 50.1 | 22.9 | 54.7 | 147 | 50.4 | — |