Intent Detection on MultiATIS++ (test)
98.77Acc (en)GL-CLEF
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GL-CLEF2022.04 | 98.77 | 97.53 | 97.05 | 97.72 | 86 | 82.84 | 96.08 | 83.92 | 87.68 | 91.95 | |
| mBERTsource=original work (Devlin et al., 2019)2022.04 | 98.54 | 95.4 | 96.3 | 94.31 | 82.41 | 76.18 | 94.95 | 75.1 | 82.53 | 88.42 | |
| CoSDAimplementation=re-implemented, source=Qin et al., 20202022.04 | 95.74 | 94.06 | 92.29 | 77.04 | 82.75 | 73.25 | 93.05 | 80.42 | 78.95 | 87.32 | |
| mBERTsource=published paper (Xu et al., 2020)2022.04 | 95.27 | 96.35 | 95.92 | 80.96 | 79.42 | 94.96 | 69.59 | 86.27 | — | — | |
| Ensemble-Netsource=published paper (Razumovskaia et al., 2021)2022.04 | 90.26 | 92.5 | 96.64 | 95.18 | 77.88 | 77.04 | 95.3 | 75.04 | 84.99 | 87.2 |