Intent Classification on Clinc150 (test)
96.35AccuracyFT Teacher
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FT TeacherModel Role=Teacher2026.02 | 96.35 | — | — | |
| CUDStudent Model Architecture=6L-768D2026.02 | 96.07 | — | — | |
| CKDStudent Model Architecture=6L-768D2026.02 | 95.93 | — | — | |
| MGSKDStudent Model Architecture=6L-768D, trained with distillation at pretraining stage=true2026.02 | 95.42 | — | — | |
| AD-KDStudent Model Architecture=6L-768D2026.02 | 95.42 | — | — | |
| PKDStudent Model Architecture=6L-768D2026.02 | 95.09 | — | — | |
| LKDStudent Model Architecture=6L-768D2026.02 | 93.51 | — | — | |
| CUDStudent Model Architecture=4L-256D2026.02 | 93.45 | — | — | |
| PKDStudent Model Architecture=4L-256D2026.02 | 93.27 | — | — | |
| ICLModel=GPT-OSS-20B2026.02 | 92 | — | — | |
| Few-shot CoTModel=GPT-OSS-20B2026.02 | 91.7 | — | — | |
| CKDStudent Model Architecture=4L-256D2026.02 | 91.7 | — | — | |
| RandomModel=GPT-OSS-20B2026.02 | 91.6 | — | — | |
| AD-KDStudent Model Architecture=4L-256D2026.02 | 91.35 | — | — | |
| TinyBERTStudent Model Architecture=6L-768D, trained with distillation at pretraining stage=true2026.02 | 88.43 | — | — | |
| LKDStudent Model Architecture=4L-256D2026.02 | 88.31 | — | — | |
| Zero-shot CoTModel=GPT-OSS-20B2026.02 | 88.2 | — | — | |
| SetFit-ENClasses=150, Shots/class=82026.02 | 85.9 | — | — | |
| PC-CoTBackbone=Qwen-72B-Chat, Reduction Method=CBWR, Shots=52024.06 | 84.89 | — | — | |
| Meta-SelModel=GPT-OSS-20B2026.02 | 84.6 | — | — | |
| Meta-SelModel=Qwen3-8B2026.02 | 83.8 | — | — | |
| PC-CoTBackbone=gpt-3.5-turbo, Reduction Method=CBWR, Shots=32024.06 | 83.78 | — | — | |
| Meta-SelModel=DeepSeek-R1-14B2026.02 | 82.1 | — | — | |
| Meta-SelModel=Gemma3-4B2026.02 | 79 | — | — | |
| PC-CoTBackbone=LLaMA2-70B-Chat, Reduction Method=ITR, Shots=52024.06 | 73.33 | — | — | |
| Meta-SelModel=Llama2-7B2026.02 | 48.4 | — | — | |
| Ensemble baseline (Eb)2023.05 | — | 31.1 | — | |
| L2 Regularization2023.05 | — | -0.6 | -2 | |
| Label Smoothing2023.05 | — | 6.1 | 20 | |
| SWA2023.05 | — | 7.3 | 23 | |
| TGTSS2023.05 | — | 26.7 | 86 |