Automatic Speech Recognition on TED-LIUM3 (test)
0.039WEROurs.small
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ours.smallDecoder=Joint CTC-Attention, Chunk Size (seconds)=3.842025.12 | 0.039 | — | |
| Ours.smallDecoder=Joint CTC-Attention, Chunk Size (seconds)=0.962025.12 | 0.041 | — | |
| Ours.baseDecoder=Joint CTC-Attention, Chunk Size (seconds)=3.842025.12 | 0.043 | — | |
| Whisper small.enDecoder=Attention Decoding, Chunk Size (seconds)=302025.12 | 0.043 | — | |
| Ours.baseDecoder=Joint CTC-Attention, Chunk Size (seconds)=0.962025.12 | 0.044 | — | |
| Ours.smallDecoder=Attention Decoding, Chunk Size (seconds)=0.962025.12 | 0.044 | — | |
| Whisper base.enDecoder=Attention Decoding, Chunk Size (seconds)=302025.12 | 0.046 | — | |
| Ours.smallDecoder=Attention Rescoring, Chunk Size (seconds)=0.962025.12 | 0.046 | — | |
| Ours.baseDecoder=Attention Rescoring, Chunk Size (seconds)=0.962025.12 | 0.048 | — | |
| Ours.baseDecoder=Attention Decoding, Chunk Size (seconds)=0.962025.12 | 0.048 | — | |
| OracleDescription=Topline for rescoring2026.06 | 2.71 | — | |
| READCombination Strategy=Sentence-level2026.06 | 3.27 | — | |
| READ (Segment-level combination)SNR=20dB2026.06 | 3.27 | — | |
| READCombination Strategy=Segment-level2026.06 | 3.34 | — | |
| Whisper large-v3Category=Candidate Model2026.06 | 3.37 | — | |
| Best single-systemSNR=20dB2026.06 | 3.37 | — | |
| READRescoring Granularity=Sentence-level2026.06 | 3.4 | -19.43 | |
| Best single-systemSNR=10dB2026.06 | 3.65 | — | |
| READCombination Strategy=ROVER integrated with segment-level combination2026.06 | 3.71 | — | |
| ROVERStrategy=ROVER baseline2026.06 | 3.85 | — | |
| Ours.smallDecoder=Joint CTC-Attention, Chunk Size (seconds)=3.842025.12 | 3.9 | — | |
| Parakeet-TDT-v2Correction method=None2024.05 | 3.9 | — | |
| ECLMCorrection model size=0.5B, Decoding strategy=greedy, Base model=Parakeet-TDT-v22024.05 | 3.9 | 0 | |
| Qwen2.5-OmniCategory=Candidate Model2026.06 | 3.91 | — | |
| ROVERSNR=20dB2026.06 | 3.95 | — | |
| Whisper large-v3Hypothesis Rank=2nd2026.06 | 3.95 | — | |
| Ours.smallDecoder=Joint CTC-Attention, Chunk Size (seconds)=0.962025.12 | 4 | — | |
| READ (Segment-level combination)SNR=10dB2026.06 | 4.15 | — | |
| NeMoCategory=Candidate Model2026.06 | 4.21 | — | |
| Whisper large-v3Hypothesis Rank=1st2026.06 | 4.22 | — | |
| Whisper large-v3Hypothesis Rank=3rd2026.06 | 4.26 | — | |
| Ours.baseDecoder=Joint CTC-Attention, Chunk Size (seconds)=0.962025.12 | 4.3 | — | |
| Ours.baseDecoder=Joint CTC-Attention, Chunk Size (seconds)=3.842025.12 | 4.3 | — | |
| Ours.smallDecoder=Attention Decoding, Chunk Size (seconds)=0.962025.12 | 4.4 | — | |
| ROVERSNR=10dB2026.06 | 4.41 | — | |
| Ours.smallDecoder=Attention Rescoring, Chunk Size (seconds)=0.962025.12 | 4.5 | — | |
| Whisper large-v3Hypothesis Rank=4th2026.06 | 4.51 | — | |
| Whisper base.enDecoder=Attention Decoding, Chunk Size (seconds)=302025.12 | 4.6 | — | |
| Whisper small.enDecoder=Attention Decoding, Chunk Size (seconds)=302025.12 | 4.6 | — | |
| Whisper large-v3Hypothesis Rank=5th2026.06 | 4.69 | — | |
| ClozeGERBackbone=LLaMA-2-7b, Source Speech=false, LoRA=true, Logits Calibration=true, Post-processing=true2024.05 | 4.7 | 30.9 | |
| Ours.baseDecoder=Attention Rescoring, Chunk Size (seconds)=0.962025.12 | 4.7 | — | |
| ClozeGERBackbone=SpeechGPT, Source Speech=true, LoRA=true, Logits Calibration=true, Post-processing=true2024.05 | 4.8 | 29.4 | |
| Ours.baseDecoder=Attention Decoding, Chunk Size (seconds)=0.962025.12 | 4.8 | — | |
| Whisper mediumCategory=Candidate Model2026.06 | 6.69 | — | |
| Whisper-M + Llama 8B (4bit, r=4)Train=Joint, Decode=PF-S2T2026.06 | 6.7 | — | |
| Whisper Baseline2024.05 | 6.8 | — | |
| Whisper-M + Llama 8B (4bit, r=4)Train=PF-S2T, Decode=PF-S2T2026.06 | 7 | — | |
| READ (Segment-level combination)SNR=0dB2026.06 | 7.74 | — | |
| Best single-systemSNR=0dB2026.06 | 7.98 | — | |
| Whisper-M + Llama 8B (4bit, r=4)Train=S2T, Decode=S2T2026.06 | 8.9 | — | |
| DLD (Ours)nDS=12, Params (M)=94.40, Speed-up=1x2026.01 | 9.19 | — | |
| DLD (Ours)nDS=10, Params (M)=80.22, Speed-up=1.17x2026.01 | 9.24 | — | |
| Whisper-M + Llama 8B (4bit, r=4)Train=Joint, Decode=S2T2026.06 | 9.3 | — | |
| WavLM (Mref)Params (M)=94.40, Speed-up=1x2026.01 | 10.12 | — | |
| RDw-scnDS=12, Params (M)=94.40, Speed-up=1x2026.01 | 10.32 | — | |
| DLD (Ours)nDS=8, Params (M)=66.04, Speed-up=1.43x2026.01 | 10.55 | — | |
| MoE (Ours)Model=MoE, Time (s)=1.332026.03 | 10.66 | — | |
| RDw-scnDS=10, Params (M)=80.22, Speed-up=1.17x2026.01 | 10.75 | — | |
| Static Conformer ReferencenDS=12, Params (M)=31.22026.01 | 11.83 | — | |
| WhisperModel=Whisper-large-v3, Time (s)=0.362026.03 | 12.19 | — | |
| DLDnDS=12, Params (M)=31.22026.01 | 12.36 | — | |
| RDw-scnDS=8, Params (M)=66.04, Speed-up=1.43x2026.01 | 12.53 | — | |
| DLDnDS=10, Params (M)=26.062026.01 | 12.69 | — | |
| DLDnDS=8, Params (M)=20.912026.01 | 13.05 | — | |
| RDscnDS=12, Params (M)=31.22026.01 | 13.72 | — | |
| DLD (Ours)nDS=6, Params (M)=51.87, Speed-up=1.82x2026.01 | 13.89 | — | |
| RDLDnDS=10, Params (M)=26.062026.01 | 13.94 | — | |
| RDscnDS=10, Params (M)=26.062026.01 | 14.01 | — | |
| RDLDnDS=12, Params (M)=31.22026.01 | 14.03 | — | |
| RDLDnDS=8, Params (M)=20.912026.01 | 14.25 | — | |
| ROVERSNR=0dB2026.06 | 14.31 | — | |
| DLDnDS=6, Params (M)=15.762026.01 | 14.89 | — | |
| RDscnDS=8, Params (M)=20.912026.01 | 15.12 | — | |
| Whisper-MTrain=–, Decode=Beam2026.06 | 15.6 | — | |
| RDLDnDS=6, Params (M)=15.762026.01 | 15.78 | — | |
| RDscnDS=6, Params (M)=15.762026.01 | 17.24 | — | |
| RDw-scnDS=6, Params (M)=51.87, Speed-up=1.82x2026.01 | 17.74 | — | |
| DLDnDS=4, Params (M)=10.612026.01 | 20.88 | — | |
| RDLDnDS=4, Params (M)=10.612026.01 | 22.43 | — | |
| RDscnDS=4, Params (M)=10.612026.01 | 24.46 | — | |
| DLD (Ours)nDS=4, Params (M)=37.69, Speed-up=2.50x2026.01 | 24.61 | — | |
| RDw-scnDS=4, Params (M)=37.69, Speed-up=2.50x2026.01 | 31.9 | — | |
| DLDnDS=2, Params (M)=5.472026.01 | 51.4 | — | |
| RDscnDS=2, Params (M)=5.472026.01 | 54.2 | — | |
| RDLDnDS=2, Params (M)=5.472026.01 | 55.3 | — | |
| DLD (Ours)nDS=2, Params (M)=23.51, Speed-up=4.01x2026.01 | 68.79 | — | |
| RDw-scnDS=2, Params (M)=23.51, Speed-up=4.01x2026.01 | 76.76 | — |