Automatic Speech Recognition on SPGI (val)
2.15WEROracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OracleDescription=Topline for rescoring2026.06 | 2.15 | — | |
| Qwen2.5-OmniCategory=Candidate Model2026.06 | 2.76 | — | |
| READCombination Strategy=ROVER integrated with segment-level combination2026.06 | 2.8 | — | |
| READCombination Strategy=Segment-level2026.06 | 3.01 | — | |
| READCombination Strategy=Sentence-level2026.06 | 3.14 | — | |
| ROVERStrategy=ROVER baseline2026.06 | 3.15 | — | |
| READRescoring Granularity=Sentence-level2026.06 | 3.33 | -21.46 | |
| Whisper large-v3Category=Candidate Model2026.06 | 3.6 | — | |
| Whisper large-v3Hypothesis Rank=1st2026.06 | 4.24 | — | |
| NeMoCategory=Candidate Model2026.06 | 4.4 | — | |
| Whisper large-v3Hypothesis Rank=2nd2026.06 | 4.42 | — | |
| Whisper large-v3Hypothesis Rank=3rd2026.06 | 4.84 | — | |
| Whisper large-v3Hypothesis Rank=4th2026.06 | 4.93 | — | |
| Whisper large-v3Hypothesis Rank=5th2026.06 | 5.62 | — | |
| Whisper mediumCategory=Candidate Model2026.06 | 7.25 | — |