Spoken Language Understanding on Internal Traffic Dataset hard (test)
12.9ICER (Relative Improvement)transformer-based E2E SLU
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| transformer-based E2E SLUPre-training strategy=BERT, AC Pretraining, Num. Params.=115M2021.06 | 12.9 | 15 | 18.9 | |
| transformer-based E2E SLUPre-training strategy=No Pretraining, Num. Params.=115M2021.06 | 11.4 | 14.2 | 18.1 | |
| Multitask Transformer BaselineNum. Params.=101M2021.06 | 4.4 | -3.5 | 0.2 | |
| Multitask BiLSTM BaselineNum. Params.=67.3M2021.06 | 1.8 | 0.2 | 0.5 | |
| Multitask LSTM BaselineNum. Params.=45.9M2021.06 | 0 | 0 | 0 |