Intent Classification on CUREKART HINT3 (test)
91.94AccuracyDynamic Label Name Refinement
Evaluation Results
| Method | Links | |
|---|---|---|
| Dynamic Label Name RefinementBackbone=Llama3-8b-inst2024.12 | 91.94 | |
| Dynamic Label Name RefinementBackbone=Qwen2.5-7b-inst2024.12 | 90.4 | |
| RawBackbone=Qwen2.5-7b-inst2024.12 | 90.02 | |
| Chain-of-ThoughtBackbone=Qwen2.5-7b-inst2024.12 | 89.98 | |
| RawBackbone=Llama3-8b-inst2024.12 | 89.76 | |
| Chain-of-ThoughtBackbone=Llama3-8b-inst2024.12 | 89.76 | |
| Dynamic Label Name RefinementBackbone=Qwen2.5-1.5b-inst2024.12 | 84.1 | |
| RawBackbone=Qwen2.5-1.5b-inst2024.12 | 82.78 | |
| Chain-of-ThoughtBackbone=Qwen2.5-1.5b-inst2024.12 | 82.35 |