Intent Classification on SOFMATTRESS HINT3 (test)
87.4AccuracyDynamic Label Name Refinement
Evaluation Results
| Method | Links | |
|---|---|---|
| Dynamic Label Name RefinementBackbone=Qwen2.5-7b-inst2024.12 | 87.4 | |
| Dynamic Label Name RefinementBackbone=Llama3-8b-inst2024.12 | 85.4 | |
| Chain-of-ThoughtBackbone=Qwen2.5-7b-inst2024.12 | 84.46 | |
| RawBackbone=Qwen2.5-7b-inst2024.12 | 83.79 | |
| RawBackbone=Llama3-8b-inst2024.12 | 82.61 | |
| Chain-of-ThoughtBackbone=Llama3-8b-inst2024.12 | 81.1 | |
| Dynamic Label Name RefinementBackbone=Qwen2.5-1.5b-inst2024.12 | 80.63 | |
| Chain-of-ThoughtBackbone=Qwen2.5-1.5b-inst2024.12 | 73.7 | |
| RawBackbone=Qwen2.5-1.5b-inst2024.12 | 73.12 |