# Word Decoding on Willett 2023 (test) Source: [Word Decoding on Willett 2023 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-24T14:05:08.579Z Evaluation of model performance on the test split of the Willett 2023 dataset using the Word Decoding task, measured by Word Error Rate (WER). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Word Decoding | | Dataset (including any stated split) | Willett 2023 (test) | | Metric | WER | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 9 of 9 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [WER](): Lower is better; unit: PERCENT. ## Recorded results | Method | WER | Result date | Report paper | | --- | --- | --- | --- | | DCoND-LIFT | 5.77 | Not recorded | 69c21a850636e5bf4afc47d2 | | RNN–CTC + LM | 17.4 | Not recorded | 69c21a850636e5bf4afc47d2 | | Transformer Seq2Seq + MFCC + BART + rescoring | 19.4 | Not recorded | 69c21a850636e5bf4afc47d2 | | Transformer Seq2Seq + MFCC + BART | 25.6 | Not recorded | 69c21a850636e5bf4afc47d2 | | Transformer Seq2Seq + BART | 26 | Not recorded | 69c21a850636e5bf4afc47d2 | | Transformer Seq2Seq + BART + Linear DT | 28.6 | Not recorded | 69c21a850636e5bf4afc47d2 | | RNN–CTC + MFCC + BART | 29 | Not recorded | 69c21a850636e5bf4afc47d2 | | Transformer Seq2Seq + BART + No DT | 30.4 | Not recorded | 69c21a850636e5bf4afc47d2 | | RNN–CTC + BART | 30.9 | Not recorded | 69c21a850636e5bf4afc47d2 | ### DCoND-LIFT WER: 5.77. Result ID: 69c299e247f34ce924ab1b85. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RNN–CTC + LM WER: 17.4. Result ID: 69c299e247f34ce924ab1b84. [Reporting paper]() Recorded evaluation configuration: {"Base architecture":"RNN-CTC","Post-processing/Rescoring":"Language Model (LM)"}. This record does not assert independent reproduction. ### Transformer Seq2Seq + MFCC + BART + rescoring WER: 19.4. Result ID: 69c299e247f34ce924ab1b8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base architecture":"Transformer Seq2Seq","Auxiliary acoustic features (MFCC)":"true","Word-level multitask objective (BART)":"true","Post-processing/Rescoring":"true"}. This record does not assert independent reproduction. ### Transformer Seq2Seq + MFCC + BART WER: 25.6. Result ID: 69c299e247f34ce924ab1b89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base architecture":"Transformer Seq2Seq","Auxiliary acoustic features (MFCC)":"true","Word-level multitask objective (BART)":"true"}. This record does not assert independent reproduction. ### Transformer Seq2Seq + BART WER: 26. Result ID: 69c299e247f34ce924ab1b88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base architecture":"Transformer Seq2Seq","Word-level multitask objective (BART)":"true"}. This record does not assert independent reproduction. ### Transformer Seq2Seq + BART + Linear DT WER: 28.6. Result ID: 69c299e247f34ce924ab1b8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base architecture":"Transformer Seq2Seq","Word-level multitask objective (BART)":"true","Day transform protocol":"Linear DT"}. This record does not assert independent reproduction. ### RNN–CTC + MFCC + BART WER: 29. Result ID: 69c299e247f34ce924ab1b87. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base architecture":"RNN-CTC","Auxiliary acoustic features (MFCC)":"true","Word-level multitask objective (BART)":"true"}. This record does not assert independent reproduction. ### Transformer Seq2Seq + BART + No DT WER: 30.4. Result ID: 69c299e247f34ce924ab1b8c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base architecture":"Transformer Seq2Seq","Word-level multitask objective (BART)":"true","Day transform protocol":"No DT"}. This record does not assert independent reproduction. ### RNN–CTC + BART WER: 30.9. Result ID: 69c299e247f34ce924ab1b86. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base architecture":"RNN-CTC","Word-level multitask objective (BART)":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.