Intent Classification on HWU64 10-shot
89.03AccuracyDynamic Label Name Refinement
Evaluation results
| Method | Links | |
|---|---|---|
| Dynamic Label Name RefinementBackbone=Llama3-8b-inst, Shot Count=10-shot2024.12 | 89.03 | |
| Dynamic Label Name RefinementBackbone=Qwen2.5-7b-inst, Shot Count=10-shot2024.12 | 88.38 | |
| RawBackbone=Llama3-8b-inst, Shot Count=10-shot2024.12 | 88.1 | |
| Chain-of-ThoughtBackbone=Llama3-8b-inst, Shot Count=10-shot2024.12 | 87.17 | |
| RawBackbone=Qwen2.5-7b-inst, Shot Count=10-shot2024.12 | 87.08 | |
| Chain-of-ThoughtBackbone=Qwen2.5-7b-inst, Shot Count=10-shot2024.12 | 86.71 | |
| DFT++ (w/ CA, SSD)Backbone=RoBERTa, Context Augmentation=true, Sequential Self-Distillation=true2023.06 | 86.21 | |
| DFT++ (w/ CA)Backbone=RoBERTa, Context Augmentation=true2023.06 | 85.49 | |
| DFT++ (w/ SSD)Backbone=RoBERTa, Sequential Self-Distillation=true2023.06 | 84.91 | |
| SE-NLIBackbone=RoBERTa2023.06 | 84.81 | |
| IntentRoBERTaBackbone=RoBERTa2023.06 | 84.26 | |
| IsoIntentRoBERTaBackbone=RoBERTa2023.06 | 84.15 | |
| DFTBackbone=RoBERTa2023.06 | 84 | |
| SE-ParaphraseBackbone=RoBERTa2023.06 | 81.25 | |
| Dynamic Label Name RefinementBackbone=Qwen2.5-1.5b-inst, Shot Count=10-shot2024.12 | 80.76 | |
| CPFTBackbone=RoBERTa2023.06 | 79.46 | |
| RawBackbone=Qwen2.5-1.5b-inst, Shot Count=10-shot2024.12 | 78.9 | |
| Chain-of-ThoughtBackbone=Qwen2.5-1.5b-inst, Shot Count=10-shot2024.12 | 78.72 | |
| DNNC-NLIBackbone=RoBERTa2023.06 | 78.12 | |
| DNNC-IntentBackbone=RoBERTa2023.06 | 72.3 |