Slot Filling on SLURP (test)
80.61F1 ScoreTDT 0-6
Evaluation Results
| Method | Links | |
|---|---|---|
| TDT 0-6#params (M)=119, relative speedup=1.28x, max duration=62023.04 | 80.61 | |
| TDT 0-4#params (M)=119, relative speedup=1.17x, max duration=42023.04 | 80.03 | |
| TDT 0-8#params (M)=119, relative speedup=1.28x, max duration=82023.04 | 79.9 | |
| TDT 0-2#params (M)=119, relative speedup=1.17x, max duration=22023.04 | 79.43 | |
| RNNT#params (M)=119, relative speedup=-2023.04 | 79.41 | |
| PF-hbt-largeFine-tuning strategy=Partial, Encoder Backbone=HuBERT, Model Size=Large2021.11 | 78.92 | |
| EF-hbt-large-960hFine-tuning strategy=Entire, Encoder Backbone=HuBERT, Model Size=Large, Pre-training Corpus=960h2021.11 | 78.89 | |
| EF-hbt-largeFine-tuning strategy=Entire, Encoder Backbone=HuBERT, Model Size=Large2021.11 | 78.43 | |
| PF-hbt-large-960hFine-tuning strategy=Partial, Encoder Backbone=HuBERT, Model Size=Large, Pre-training Corpus=960h2021.11 | 78.17 | |
| ESPnet-SLU#params (M)=109, relative speedup=N/A2023.04 | 76.91 | |
| SpeechBrain#params (M)=96, relative speedup=N/A2023.04 | 76.19 | |
| PF-hbt-baseFine-tuning strategy=Partial, Encoder Backbone=HuBERT, Model Size=Base2021.11 | 75.32 | |
| EF-hbt-baseFine-tuning strategy=Entire, Encoder Backbone=HuBERT, Model Size=Base2021.11 | 75.06 | |
| PF-w2v-baseFine-tuning strategy=Partial, Encoder Backbone=wav2vec 2.0, Model Size=Base2021.11 | 74.73 | |
| CTI2021.11 | 74.66 | |
| EF-w2v-base-960hFine-tuning strategy=Entire, Encoder Backbone=wav2vec 2.0, Model Size=Base, Pre-training Corpus=960h2021.11 | 74.33 | |
| EF-w2v-baseFine-tuning strategy=Entire, Encoder Backbone=wav2vec 2.0, Model Size=Base2021.11 | 74.32 | |
| PF-w2v-large-960hFine-tuning strategy=Partial, Encoder Backbone=wav2vec 2.0, Model Size=Large, Pre-training Corpus=960h2021.11 | 74.03 | |
| PF-w2v-base-960hFine-tuning strategy=Partial, Encoder Backbone=wav2vec 2.0, Model Size=Base, Pre-training Corpus=960h2021.11 | 73.78 | |
| EF-w2v-large-960hFine-tuning strategy=Entire, Encoder Backbone=wav2vec 2.0, Model Size=Large, Pre-training Corpus=960h2021.11 | 73.39 | |
| PF-w2v-largeFine-tuning strategy=Partial, Encoder Backbone=wav2vec 2.0, Model Size=Large2021.11 | 73.16 | |
| EF-w2v-largeFine-tuning strategy=Entire, Encoder Backbone=wav2vec 2.0, Model Size=Large2021.11 | 72.45 | |
| Frozen-hbt-largeFine-tuning strategy=Frozen, Encoder Backbone=HuBERT, Model Size=Large2021.11 | 60.07 | |
| Frozen-hbt-baseFine-tuning strategy=Frozen, Encoder Backbone=HuBERT, Model Size=Base2021.11 | 57.06 | |
| Frozen-w2v-baseFine-tuning strategy=Frozen, Encoder Backbone=wav2vec 2.0, Model Size=Base2021.11 | 37.66 | |
| Frozen-w2v-largeFine-tuning strategy=Frozen, Encoder Backbone=wav2vec 2.0, Model Size=Large2021.11 | 3.85 |