# Automatic Speech Recognition on Earnings21 long-form (test)

Source: [Automatic Speech Recognition on Earnings21 long-form (test)](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-earnings21-long-form-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:08:35.258Z

Evaluation of Automatic Speech Recognition performance on the test split of the Earnings21 long-form dataset, measured using Word Error Rate (WER).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Automatic Speech Recognition |
| Dataset (including any stated split) | Earnings21 long-form (test) |
| Metric | WER |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [WER](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-earnings21-long-form-test.md?metric=WER>): Lower is better; unit: PERCENT.

## Recorded results

| Method | WER | Result date | Report paper |
| --- | --- | --- | --- |
| Whisper small.en | 10.8 | Not recorded | 694239304561469362850761 |
| Ours.small | 11.4 | Not recorded | 694239304561469362850761 |
| Ours.small | 11.4 | Not recorded | 694239304561469362850761 |
| Ours.base | 12.1 | Not recorded | 694239304561469362850761 |
| Ours.small | 12.1 | Not recorded | 694239304561469362850761 |
| Ours.base | 12.2 | Not recorded | 694239304561469362850761 |
| Whisper base.en | 12.5 | Not recorded | 694239304561469362850761 |
| Ours.small | 12.5 | Not recorded | 694239304561469362850761 |
| Ours.base | 13.3 | Not recorded | 694239304561469362850761 |
| Ours.base | 13.4 | Not recorded | 694239304561469362850761 |

### Whisper small.en

WER: 10.8. Result ID: 699a19175698665ec49d893f.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e51b.md>)

[Implementation](<https://github.com/openai/whisper>)

Recorded evaluation configuration: {"Decoder":"Attention Decoding","Chunk Size (seconds)":30}. This record does not assert independent reproduction.

### Ours.small

WER: 11.4. Result ID: 699a19175698665ec49d8942.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Joint CTC-Attention","Chunk Size (seconds)":0.96}. This record does not assert independent reproduction.

### Ours.small

WER: 11.4. Result ID: 699a19175698665ec49d8943.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Joint CTC-Attention","Chunk Size (seconds)":3.84}. This record does not assert independent reproduction.

### Ours.base

WER: 12.1. Result ID: 699a19175698665ec49d893e.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Joint CTC-Attention","Chunk Size (seconds)":3.84}. This record does not assert independent reproduction.

### Ours.small

WER: 12.1. Result ID: 699a19175698665ec49d8941.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Attention Decoding","Chunk Size (seconds)":0.96}. This record does not assert independent reproduction.

### Ours.base

WER: 12.2. Result ID: 699a19175698665ec49d893d.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Joint CTC-Attention","Chunk Size (seconds)":0.96}. This record does not assert independent reproduction.

### Whisper base.en

WER: 12.5. Result ID: 699a19175698665ec49d893a.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e51b.md>)

[Implementation](<https://github.com/openai/whisper>)

Recorded evaluation configuration: {"Decoder":"Attention Decoding","Chunk Size (seconds)":30}. This record does not assert independent reproduction.

### Ours.small

WER: 12.5. Result ID: 699a19175698665ec49d8940.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Attention Rescoring","Chunk Size (seconds)":0.96}. This record does not assert independent reproduction.

### Ours.base

WER: 13.3. Result ID: 699a19175698665ec49d893c.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Attention Decoding","Chunk Size (seconds)":0.96}. This record does not assert independent reproduction.

### Ours.base

WER: 13.4. Result ID: 699a19175698665ec49d893b.

[Reporting paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694239304561469362850761.md>)

Recorded evaluation configuration: {"Decoder":"Attention Rescoring","Chunk Size (seconds)":0.96}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
