Joint Multiple Intent Detection and Slot Filling on MixATIS (test)
90.5F1 Score (Slot)MISCA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MISCAPLM=None2023.12 | 90.5 | 53 | 76.7 | — | |
| Rela-NetPLM=None2023.12 | 90.1 | 52.2 | 78.5 | — | |
| Co-guiding Net2022.10 | 89.8 | 51.3 | 79.1 | — | |
| Co-guidingPLM=None2023.12 | 89.8 | 51.3 | 79.1 | — | |
| SSRANPLM=None2023.12 | 89.4 | 48.9 | 77.9 | — | |
| SSRANPre-trained language model=BERT-base2023.08 | 89.4 | — | 77.9 | 48.9 | |
| BiSLUPre-trained language model=BERT-base2023.08 | 89.4 | — | 81.5 | 51.5 | |
| DGMPre-trained language model=BERT-base2023.08 | 88.7 | — | 76.7 | 47.1 | |
| DGIFBackbone=Bert-base2022.11 | 88.5 | 50.7 | 83.3 | — | |
| GISCOPLM=None2023.12 | 88.5 | 48.2 | 75 | — | |
| GISCOPre-trained language model=BERT-base2023.08 | 88.5 | — | 75 | 48.2 | |
| SLIMPre-trained language model=BERT-base2023.08 | 88.5 | — | 78.3 | 47.6 | |
| GL-GIN2022.11 | 88.3 | 43.5 | 76.3 | — | |
| GL-GINPLM=None2023.12 | 88.3 | 43.5 | 76.3 | — | |
| GL-GINPre-trained language model=BERT-base2023.08 | 88.3 | — | 76.3 | 43.5 | |
| GL-GIN2022.10 | 88.2 | 43 | 76.3 | — | |
| SDJN2022.11 | 88.2 | 44.6 | 77.1 | — | |
| SDJNPLM=None2023.12 | 88.2 | 44.6 | 77.1 | — | |
| SDJNPre-trained language model=BERT-base2023.08 | 88.2 | — | 77.1 | 44.6 | |
| TFMNPre-trained language model=BERT-base2023.08 | 88 | — | 79.8 | 50.2 | |
| Stack-Propagation2022.10 | 87.8 | 40.1 | 72.1 | — | |
| Stack-Propagation2022.11 | 87.8 | 40.1 | 72.1 | — | |
| Stack-PropagationPre-trained language model=BERT-base2023.08 | 87.8 | — | 72.1 | 40.1 | |
| Slot-Gated2022.10 | 87.7 | 35.5 | 63.9 | — | |
| Slot-GatedPre-trained language model=BERT-base2023.08 | 87.7 | — | 63.9 | 35.5 | |
| SF-ID2022.10 | 87.4 | 34.9 | 66.2 | — | |
| SF-ID2022.11 | 87.4 | 34.9 | 66.2 | — | |
| SF-IDPre-trained language model=BERT-base2023.08 | 87.4 | — | 66.2 | 34.9 | |
| AGIF2022.10 | 86.7 | 40.8 | 74.4 | — | |
| AGIF2022.11 | 86.7 | 40.8 | 74.4 | — | |
| AGIFPLM=None2023.12 | 86.7 | 40.8 | 74.4 | — | |
| AGIFPre-trained language model=BERT-base2023.08 | 86.7 | — | 74.4 | 40.8 | |
| Attention BiRNN2022.10 | 86.4 | 39.1 | 74.6 | — | |
| Attention BiRNNPre-trained language model=BERT-base2023.08 | 86.4 | — | 74.6 | 39.1 | |
| Bert-baselineBackbone=Bert-base2022.11 | 86.3 | 44.8 | 74.5 | — | |
| Roberta-baselineBackbone=Roberta-base2022.11 | 85 | 47.8 | 78.3 | — | |
| Joint Multiple ID-SF2022.10 | 84.6 | 36.1 | 73.4 | — | |
| Joint Multiple ID-SF2022.11 | 84.6 | 36.1 | 73.4 | — | |
| Joint Multiple ID-SFPre-trained language model=BERT-base2023.08 | 84.6 | — | 73.4 | 36.1 | |
| Bi-Model2022.10 | 83.9 | 34.4 | 70.3 | — | |
| Bi-Model2022.11 | 83.9 | 34.4 | 70.3 | — | |
| Bi-ModelPre-trained language model=BERT-base2023.08 | 83.9 | — | 70.3 | 34.4 | |
| AGIFPLM=RoBERTa_base2023.12 | — | 50 | — | — | |
| Co-guidingPLM=RoBERTa_base2023.12 | — | 57.5 | — | — | |
| DGIFPLM=BERT2023.12 | — | 50.7 | — | — | |
| GL-GINPLM=RoBERTa_base2023.12 | — | 53.6 | — | — | |
| MISCAPLM=RoBERTa_base2023.12 | — | 59.1 | — | — | |
| Rela-NetPLM=RoBERTa_base2023.12 | — | 58.4 | — | — | |
| SLIMPLM=BERT2023.12 | — | 47.6 | — | — | |
| SSRANPLM=RoBERTa_base2023.12 | — | 54.4 | — | — | |
| TFMNPLM=BERT2023.12 | — | 50.2 | — | — | |
| UGENPLM=T52023.12 | — | 55.3 | — | — |