Intent Classification on BANKING77 (10-shot)
87.95AccuracyDynamic Label Name Refinement
Evaluation Results
| Method | Links | |
|---|---|---|
| Dynamic Label Name RefinementBackbone=Llama3-8b-inst, Shot Count=10-shot2024.12 | 87.95 | |
| Dynamic Label Name RefinementBackbone=Qwen2.5-7b-inst, Shot Count=10-shot2024.12 | 87.3 | |
| Chain-of-ThoughtBackbone=Qwen2.5-7b-inst, Shot Count=10-shot2024.12 | 87.05 | |
| DFT++ (w/ CA, SSD)Backbone=RoBERTa, Context Augmentation=true, Sequential Self-Distillation=true2023.06 | 86.14 | |
| DFT++ (w/ CA)Backbone=RoBERTa, Context Augmentation=true2023.06 | 85.95 | |
| RawBackbone=Llama3-8b-inst, Shot Count=10-shot2024.12 | 85.88 | |
| RawBackbone=Qwen2.5-7b-inst, Shot Count=10-shot2024.12 | 85.68 | |
| Chain-of-ThoughtBackbone=Llama3-8b-inst, Shot Count=10-shot2024.12 | 85.48 | |
| DFT++ (w/ SSD)Backbone=RoBERTa, Sequential Self-Distillation=true2023.06 | 84.95 | |
| DFTBackbone=RoBERTa2023.06 | 84.77 | |
| SE-NLIBackbone=RoBERTa2023.06 | 84.65 | |
| IsoIntentRoBERTaBackbone=RoBERTa2023.06 | 84.49 | |
| IntentRoBERTaBackbone=RoBERTa2023.06 | 83.94 | |
| SE-ParaphraseBackbone=RoBERTa2023.06 | 82.85 | |
| DNNC-NLIBackbone=RoBERTa2023.06 | 79.51 | |
| CPFTBackbone=RoBERTa2023.06 | 78.57 | |
| DNNC-IntentBackbone=RoBERTa2023.06 | 77.69 | |
| Dynamic Label Name RefinementBackbone=Qwen2.5-1.5b-inst, Shot Count=10-shot2024.12 | 77.34 | |
| RawBackbone=Qwen2.5-1.5b-inst, Shot Count=10-shot2024.12 | 73.31 | |
| Chain-of-ThoughtBackbone=Qwen2.5-1.5b-inst, Shot Count=10-shot2024.12 | 72.63 |