Multilabel Intent Classification on MALINT
81.7Micro F1DeBERTa V3 Large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DeBERTa V3 LargeModel Type=Small Language Model, Setting=Fine-tuned2026.03 | 81.7 | 81.5 | |
| RoBERTa BaseModel Type=Small Language Model, Setting=Fine-tuned2026.03 | 81.3 | 82.1 | |
| DeBERTa V3 BaseModel Type=Small Language Model, Setting=Fine-tuned2026.03 | 81.2 | 80.4 | |
| RoBERTa LargeModel Type=Small Language Model, Setting=Fine-tuned2026.03 | 77.5 | 80.8 | |
| DistilBERT BaseModel Type=Small Language Model, Setting=Fine-tuned2026.03 | 75.9 | 76.9 | |
| BERT LargeModel Type=Small Language Model, Setting=Fine-tuned2026.03 | 57.8 | 52.1 | |
| Llama 3.3 70BModel Type=Large Language Model, Setting=Zero-shot2026.03 | 54.2 | 57 | |
| LR with BoW (OvR)Model Type=Baseline2026.03 | 50.3 | 49.1 | |
| GPT 4.1 MiniModel Type=Large Language Model, Setting=Zero-shot2026.03 | 48.9 | 49.8 | |
| GPT 4o MiniModel Type=Large Language Model, Setting=Zero-shot2026.03 | 44.6 | 45.7 | |
| Gemma 3 27B itModel Type=Large Language Model, Setting=Zero-shot2026.03 | 44 | 48.5 | |
| BERT BaseModel Type=Small Language Model, Setting=Fine-tuned2026.03 | 42.1 | 41.4 | |
| Gemini 2.0 FlashModel Type=Large Language Model, Setting=Zero-shot2026.03 | 41 | 40.4 | |
| RandomModel Type=Baseline2026.03 | 19.2 | 20.1 |