Intent Classification on HINT3 5-shot
63.96AccuracySE-Paraphrase
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SE-ParaphraseBackbone=RoBERTa2023.06 | 63.96 | — | — | — | — | |
| DFT++ (w/ CA, SSD)Backbone=RoBERTa, Context Augmentation=true, Sequential Self-Distillation=true2023.06 | 63.61 | — | — | — | — | |
| DFT++ (w/ CA)Backbone=RoBERTa, Context Augmentation=true2023.06 | 63.17 | — | — | — | — | |
| DFT++Backbone=BERT, Context Augmentation=true, Sequential Self-distillation=true2023.06 | 63.08 | — | — | — | — | |
| SE-NLIBackbone=RoBERTa2023.06 | 62.6 | — | — | — | — | |
| SE-ParaphraseBackbone=BERT2023.06 | 62.28 | — | — | — | — | |
| SE-NLIBackbone=BERT2023.06 | 61.69 | — | — | — | — | |
| CPFTBackbone=BERT2023.06 | 61.63 | — | — | — | — | |
| DFT++Backbone=BERT, Context Augmentation=false, Sequential Self-distillation=true2023.06 | 61.51 | — | — | — | — | |
| DFTBackbone=RoBERTa2023.06 | 61.39 | — | — | — | — | |
| DFT++ (w/ SSD)Backbone=RoBERTa, Sequential Self-Distillation=true2023.06 | 61.3 | — | — | — | — | |
| DNNC-IntentBackbone=RoBERTa2023.06 | 61.15 | — | — | — | — | |
| IntentRoBERTaBackbone=RoBERTa2023.06 | 60.77 | — | — | — | — | |
| DFTBackbone=BERT, Context Augmentation=false, Sequential Self-distillation=false2023.06 | 60.65 | — | — | — | — | |
| DFT++Backbone=BERT, Context Augmentation=true, Sequential Self-distillation=false2023.06 | 60.53 | — | — | — | — | |
| IsoIntentBERTBackbone=BERT2023.06 | 60.33 | — | — | — | — | |
| IsoIntentRoBERTaBackbone=RoBERTa2023.06 | 59.79 | — | — | — | — | |
| DNNC-NLIBackbone=RoBERTa2023.06 | 59.73 | — | — | — | — | |
| DNNC-NLIBackbone=BERT2023.06 | 59.05 | — | — | — | — | |
| IntentBERTBackbone=BERT2023.06 | 58.96 | — | — | — | — | |
| CPFTBackbone=RoBERTa2023.06 | 58.17 | — | — | — | — | |
| DNNC-IntentBackbone=BERT2023.06 | 58.08 | — | — | — | — | |
| TOD-BERTBackbone=BERT2023.06 | 56.33 | — | — | — | — | |
| CINSBackbone=T5-base, Shots=5-shot2023.06 | — | 89.1 | 80.2 | 95.4 | 93.7 | |
| DFT++ (BERT)Backbone=BERT, Shots=5-shot2023.06 | — | 91.39 | 82.11 | 96.16 | 90.64 | |
| DFT++ (RoBERTa)Backbone=RoBERTa, Shots=5-shot2023.06 | — | 93.76 | 86.21 | 97.39 | 93.31 |