Spoken Language Understanding on ATIS (test)
96.89Slot F1Bi-model
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Bi-model2019.09 | 96.89 | 98.99 | — | |
| Self-Attention, Intent Gate2019.09 | 96.52 | 98.77 | — | |
| CM-Net2019.09 | 96.2 | 99.1 | — | |
| BERT SLUBackbone=BERT2019.09 | 96.1 | 97.5 | 88.2 | |
| Stack-PropagationBackbone=BERT2019.09 | 96.1 | 97.5 | 88.6 | |
| Joint BERT2019.09 | 96.1 | 97.5 | — | |
| Attention Bi-RNNsource=retrieved from Slot-Gated (Goo et al., 2018)2019.09 | 95.98 | 98.21 | — | |
| Stack-PropagationBackbone=Baseline2019.09 | 95.9 | 96.9 | 86.5 | |
| Sentence-State LSTMimplementation=ours2019.09 | 95.65 | 98.21 | — | |
| BiLSTMs + ELMoLembedding=ELMoL2019.09 | 95.62 | 97.42 | — | |
| Slot filling (BERT)Backbone=BERT, Task=Single-task Slot filling2019.09 | 95.6 | — | — | |
| Dilated CNN, Label-Recurrent2019.09 | 95.54 | 98.1 | — | |
| Joint GRU2019.09 | 95.49 | 98.1 | — | |
| BiLSTMs + ELMoembedding=ELMo2019.09 | 95.42 | 97.3 | — | |
| Slot-Gated (Intent Atten.)2019.09 | 95.2 | 94.1 | — | |
| CAPSULE-NLU2019.09 | 95.2 | 95 | — | |
| Slot-Gated (Full Atten.)2019.09 | 94.8 | 93.6 | — | |
| Joint Seq2Seqsource=retrieved from Slot-Gated (Goo et al., 2018)2019.09 | 94.2 | 92.6 | — | |
| Intent detection (BERT)Backbone=BERT, Task=Single-task Intent detection2019.09 | — | 96.5 | — |