Multi-intent Natural Language Understanding on MixATIS (test)
50.4Overall AccuracySLIM (PACL)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SLIM (PACL)Data Regime=Full-Data2024.05 | 50.4 | 81.9 | 87.3 | |
| TFMN (PACL)Data Regime=Full-Data2024.05 | 49.4 | 82.9 | 86.7 | |
| RoBERTa (PACL)Data Regime=Full-Data2024.05 | 48.9 | 79.1 | 86 | |
| TFMNData Regime=Full-Data, Reproduced=true2024.05 | 48.6 | 81.5 | 86.9 | |
| GISCOData Regime=Full-Data2024.05 | 48.2 | — | — | |
| RoBERTaData Regime=Full-Data, Reproduced=true2024.05 | 47.7 | 77.5 | 85.5 | |
| SLIMData Regime=Full-Data2024.05 | 46.4 | 78.9 | 87.1 | |
| SDJN+BERTData Regime=Full-Data2024.05 | 46.3 | 78 | 87.5 | |
| AGIFData Regime=Full-Data2024.05 | 44.5 | 75.8 | 88.1 | |
| GL-GINData Regime=Full-Data2024.05 | 43.5 | 76.3 | 88.3 | |
| RoBERTa (PACL)Data Regime=Low-Data2024.05 | 36.8 | 66.2 | 84 | |
| RoBERTaData Regime=Low-Data, Reproduced=true2024.05 | 24.9 | 46.7 | 84.1 | |
| SLIM (PACL)Data Regime=Low-Data2024.05 | 23.3 | 60.8 | 75.8 | |
| TFMN (PACL)Data Regime=Low-Data2024.05 | 18.1 | 58.3 | 72.7 | |
| SLIMData Regime=Low-Data2024.05 | 16.1 | 52.8 | 72.4 | |
| TFMNData Regime=Low-Data, Reproduced=true2024.05 | 15.7 | 46.4 | 71.1 |