Intent Classification on HINT3 10-shot
71.8AccuracyDFT++ (w/ CA, SSD)
Evaluation results
| Method | Links | |
|---|---|---|
| DFT++ (w/ CA, SSD)Backbone=RoBERTa, Context Augmentation=true, Sequential Self-Distillation=true2023.06 | 71.8 | |
| DFT++ (w/ CA)Backbone=RoBERTa, Context Augmentation=true2023.06 | 71.3 | |
| DFT++Backbone=BERT, Context Augmentation=true, Sequential Self-distillation=true2023.06 | 70.47 | |
| DFT++Backbone=BERT, Context Augmentation=true, Sequential Self-distillation=false2023.06 | 70.36 | |
| DFT++ (w/ SSD)Backbone=RoBERTa, Sequential Self-Distillation=true2023.06 | 70.12 | |
| SE-ParaphraseBackbone=BERT2023.06 | 70 | |
| SE-NLIBackbone=RoBERTa2023.06 | 69.91 | |
| CPFTBackbone=BERT2023.06 | 69.85 | |
| IsoIntentBERTBackbone=BERT2023.06 | 69.23 | |
| SE-ParaphraseBackbone=RoBERTa2023.06 | 69.14 | |
| IsoIntentRoBERTaBackbone=RoBERTa2023.06 | 69.08 | |
| IntentBERTBackbone=BERT2023.06 | 68.96 | |
| IntentRoBERTaBackbone=RoBERTa2023.06 | 68.91 | |
| DFT++Backbone=BERT, Context Augmentation=false, Sequential Self-distillation=true2023.06 | 68.82 | |
| DFTBackbone=RoBERTa2023.06 | 68.4 | |
| SE-NLIBackbone=BERT2023.06 | 68.37 | |
| DNNC-IntentBackbone=RoBERTa2023.06 | 66.45 | |
| TOD-BERTBackbone=BERT2023.06 | 66.42 | |
| DFTBackbone=BERT, Context Augmentation=false, Sequential Self-distillation=false2023.06 | 66.36 | |
| DNNC-NLIBackbone=BERT2023.06 | 65.12 | |
| DNNC-IntentBackbone=BERT2023.06 | 64.56 | |
| DNNC-NLIBackbone=RoBERTa2023.06 | 64.05 | |
| CPFTBackbone=RoBERTa2023.06 | 61.07 |