Natural Language Understanding on ATIS (test)
97.9Intent AccuracyJoint BERT + CRF
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Joint BERT + CRFBackbone=BERT-Base, Decoder=CRF2019.02 | 97.9 | 96 | 88.6 | — | |
| SF-ID NetworkMode=SF-First, CRF=with2019.06 | 97.76 | 95.75 | — | 86.79 | |
| Joint BERTBackbone=BERT-Base2019.02 | 97.5 | 96.1 | 88.2 | — | |
| SF-ID NetworkMode=SF-First, CRF=without2019.06 | 97.4 | 95.55 | — | 85.95 | |
| SF-ID NetworkMode=ID-First, CRF=with2019.06 | 97.09 | 95.8 | — | 86.9 | |
| SF-ID NetworkMode=ID-First, CRF=without2019.06 | 96.58 | 95.58 | — | 86 | |
| Sloted-Gated2019.06 | 95.41 | 95.42 | — | 83.73 | |
| Slot-Gated2019.02 | 94.1 | 95.2 | 82.6 | — | |
| RNN-LSTM2019.02 | 92.6 | 94.3 | 80.7 | — | |
| Joint Seq2019.06 | 92.6 | 94.3 | — | 80.7 | |
| Atten.-BiRNN2019.02 | 91.1 | 94.2 | 78.9 | — | |
| Atten.-Based2019.06 | 91.1 | 94.2 | — | 78.9 |