Intent Classification on MASSIVE (test)
89.47In-Scope AccuracyFT Teacher
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FT TeacherModel Role=Teacher2026.02 | 89.47 | — | — | — | |
| CUDStudent Model Architecture=6L-768D2026.02 | 89.44 | — | — | — | |
| AD-KDStudent Model Architecture=6L-768D2026.02 | 89.3 | — | — | — | |
| CKDStudent Model Architecture=6L-768D2026.02 | 89.3 | — | — | — | |
| LKDStudent Model Architecture=6L-768D2026.02 | 88.94 | — | — | — | |
| TinyBERTStudent Model Architecture=6L-768D, trained with distillation at pretraining stage=true2026.02 | 88.84 | — | — | — | |
| MGSKDStudent Model Architecture=6L-768D, trained with distillation at pretraining stage=true2026.02 | 88.56 | — | — | — | |
| PKDStudent Model Architecture=6L-768D2026.02 | 88.17 | — | — | — | |
| PKDStudent Model Architecture=4L-256D2026.02 | 87.23 | — | — | — | |
| CUDStudent Model Architecture=4L-256D2026.02 | 87.22 | — | — | — | |
| CKDStudent Model Architecture=4L-256D2026.02 | 86.6 | — | — | — | |
| AD-KDStudent Model Architecture=4L-256D2026.02 | 84.17 | — | — | — | |
| LKDStudent Model Architecture=4L-256D2026.02 | 82 | — | — | — | |
| GPT-3LLM Intents=60, parameters=175B, Evaluation Mode=zero-shot2023.05 | 73.9 | — | — | — | |
| Flan-T5-XXLLLM Intents=60, parameters=11B, Evaluation Mode=zero-shot2023.05 | 73.3 | — | — | — | |
| GPT-3LLM Intents=5, parameters=175B, Evaluation Mode=zero-shot2023.05 | 69.2 | — | — | — | |
| Flan-T5-XXLLLM Intents=5, parameters=11B, Evaluation Mode=zero-shot2023.05 | 68.6 | — | — | — | |
| OLABackbone=Qwen3, MLP Width=256, Activation Scheme=OLA2026.05 | — | — | 85.56 | — | |
| PreciseBackbone=Qwen3, MLP Width=256, Activation Scheme=Prec.2026.05 | — | — | 85.56 | — | |
| QUAD4FHEBackbone=Qwen3, MLP Width=256, Activation Scheme=Quad.2026.05 | — | — | 85.45 | 98.69 | |
| ReLUBackbone=Qwen3, MLP Width=256, Activation Scheme=ReLU2026.05 | — | — | 85.56 | — | |
| Remez-7Backbone=Qwen3, MLP Width=256, Activation Scheme=Rmz-72026.05 | — | — | 85.49 | — | |
| SquareBackbone=Qwen3, MLP Width=256, Activation Scheme=Sq.2026.05 | — | — | 52.4 | — |