Joint Multiple Intent Detection and Slot Filling on MixSNIPS (test)
97.2Slot F1BiSLU
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BiSLUPre-trained language model=BERT-base2023.08 | 97.2 | — | 97.8 | 85.4 | |
| SLIM (PACL)Data Regime=Full-Data2024.05 | 96.8 | 85.1 | 96.9 | — | |
| SLIMPre-trained language model=BERT-base2023.08 | 96.5 | — | 97.2 | 84 | |
| TFMNPre-trained language model=BERT-base2023.08 | 96.4 | — | 97.7 | 84.7 | |
| TFMN (PACL)Data Regime=Full-Data2024.05 | 96.3 | 83.6 | 97.4 | — | |
| SLIMData Regime=Full-Data2024.05 | 96.3 | 83.7 | 96.8 | — | |
| RoBERTa (PACL)Data Regime=Full-Data2024.05 | 96.2 | 83.4 | 96.5 | — | |
| TFMNData Regime=Full-Data, Reproduced=true2024.05 | 96.1 | 83.4 | 97.1 | — | |
| Roberta-baselineBackbone=Roberta-base2022.11 | 95.9 | 83.2 | 97.5 | — | |
| DGIFBackbone=Bert-base2022.11 | 95.9 | 84.3 | 97.8 | — | |
| SSRANPLM=None2023.12 | 95.8 | 77.5 | 98.4 | — | |
| SSRANPre-trained language model=BERT-base2023.08 | 95.8 | — | 98.4 | 77.5 | |
| RoBERTaData Regime=Full-Data, Reproduced=true2024.05 | 95.6 | 80.9 | 96.5 | — | |
| Bert-baselineBackbone=Bert-base2022.11 | 95.5 | 80.1 | 95.6 | — | |
| SDJN+BERTData Regime=Full-Data2024.05 | 95.4 | 79.3 | 96.7 | — | |
| MISCAPLM=None2023.12 | 95.2 | 77.9 | 97.3 | — | |
| Co-guiding Net2022.10 | 95.1 | 77.5 | 97.7 | — | |
| Co-guidingPLM=None2023.12 | 95.1 | 77.5 | 97.7 | — | |
| GISCOPLM=None2023.12 | 95 | 75.9 | 95.5 | — | |
| GISCOPre-trained language model=BERT-base2023.08 | 95 | — | 95.5 | 75.9 | |
| GL-GIN2022.11 | 94.9 | 75.4 | 95.6 | — | |
| GL-GINPLM=None2023.12 | 94.9 | 75.4 | 95.6 | — | |
| GL-GINPre-trained language model=BERT-base2023.08 | 94.9 | — | 95.6 | 75.4 | |
| GL-GINData Regime=Full-Data2024.05 | 94.9 | 75.4 | 95.6 | — | |
| Rela-NetPLM=None2023.12 | 94.7 | 76.1 | 97.6 | — | |
| DGMPre-trained language model=BERT-base2023.08 | 94.7 | — | 96.7 | 78 | |
| AGIFData Regime=Full-Data2024.05 | 94.5 | 76.4 | 96.5 | — | |
| SDJN2022.11 | 94.4 | 75.7 | 96.5 | — | |
| SDJNPLM=None2023.12 | 94.4 | 75.7 | 96.5 | — | |
| SDJNPre-trained language model=BERT-base2023.08 | 94.4 | — | 96.5 | 75.7 | |
| SLIM (PACL)Data Regime=Low-Data2024.05 | 94.4 | 75.4 | 95.2 | — | |
| Stack-Propagation2022.10 | 94.2 | 72.9 | 96 | — | |
| AGIF2022.10 | 94.2 | 74.2 | 95.1 | — | |
| Stack-Propagation2022.11 | 94.2 | 72.9 | 96 | — | |
| AGIF2022.11 | 94.2 | 74.2 | 95.1 | — | |
| AGIFPLM=None2023.12 | 94.2 | 74.2 | 95.1 | — | |
| Stack-PropagationPre-trained language model=BERT-base2023.08 | 94.2 | — | 96 | 72.9 | |
| AGIFPre-trained language model=BERT-base2023.08 | 94.2 | — | 95.1 | 74.2 | |
| GL-GIN2022.10 | 94 | 73.7 | 95.7 | — | |
| SLIMData Regime=Low-Data2024.05 | 93.4 | 73.8 | 93.9 | — | |
| RoBERTa (PACL)Data Regime=Low-Data2024.05 | 92.9 | 69.6 | 94.8 | — | |
| RoBERTaData Regime=Low-Data, Reproduced=true2024.05 | 92.3 | 67.5 | 94 | — | |
| TFMN (PACL)Data Regime=Low-Data2024.05 | 91.9 | 67.8 | 95.5 | — | |
| TFMNData Regime=Low-Data, Reproduced=true2024.05 | 90.9 | 65.2 | 95.2 | — | |
| Bi-Model2022.10 | 90.7 | 63.4 | 95.6 | — | |
| Bi-Model2022.11 | 90.7 | 63.4 | 95.6 | — | |
| Bi-ModelPre-trained language model=BERT-base2023.08 | 90.7 | — | 95.6 | 63.4 | |
| SF-ID2022.10 | 90.6 | 59.9 | 95 | — | |
| Joint Multiple ID-SF2022.10 | 90.6 | 62.9 | 95.1 | — | |
| SF-ID2022.11 | 90.6 | 59.9 | 95 | — | |
| Joint Multiple ID-SF2022.11 | 90.6 | 62.9 | 95.1 | — | |
| SF-IDPre-trained language model=BERT-base2023.08 | 90.6 | — | 95 | 59.9 | |
| Joint Multiple ID-SFPre-trained language model=BERT-base2023.08 | 90.6 | — | 95.1 | 62.9 | |
| Attention BiRNN2022.10 | 89.4 | 59.5 | 95.4 | — | |
| Attention BiRNNPre-trained language model=BERT-base2023.08 | 89.4 | — | 95.4 | 59.5 | |
| Slot-Gated2022.10 | 87.9 | 55.4 | 94.6 | — | |
| Slot-GatedPre-trained language model=BERT-base2023.08 | 87.9 | — | 94.6 | 55.4 | |
| AGIFPLM=RoBERTa_base2023.12 | — | 80.7 | — | — | |
| Co-guidingPLM=RoBERTa_base2023.12 | — | 85.3 | — | — | |
| DGIFPLM=BERT2023.12 | — | 84.3 | — | — | |
| GISCOData Regime=Full-Data2024.05 | — | 75.9 | — | — | |
| GL-GINPLM=RoBERTa_base2023.12 | — | 82.6 | — | — | |
| MISCAPLM=RoBERTa_base2023.12 | — | 86.2 | — | — | |
| Rela-NetPLM=RoBERTa_base2023.12 | — | 83.8 | — | — | |
| SLIMPLM=BERT2023.12 | — | 84 | — | — | |
| SSRANPLM=RoBERTa_base2023.12 | — | 83.1 | — | — | |
| TFMNPLM=BERT2023.12 | — | 84.7 | — | — | |
| UGENPLM=T52023.12 | — | 78.8 | — | — |