Intent Detection on M2M
94.27AccuracyMIDAS
Evaluation Results
| Method | Links | |
|---|---|---|
| MIDASBackbone=BERT-Base2024.08 | 94.27 | |
| MIDASmodel_description=Our best model2024.08 | 94.27 | |
| Tri-level JNLU2024.08 | 94.19 | |
| MIDASBackbone=ROBERTa-Base2024.08 | 93.77 | |
| Slot-Gated2024.08 | 93.27 | |
| ROBERTa-Base2024.08 | 92.52 | |
| SeqSeq2024.08 | 92.5 | |
| BERT-Base2024.08 | 86.75 | |
| ALBERT-Base2024.08 | 86.54 | |
| GPT4o+2024.08 | 75.1 | |
| GPT4o2024.08 | 64.1 | |
| GPT3.52024.08 | 51 | |
| Gemma-7b2024.08 | 45.88 | |
| LLaMa2-7b-chat2024.08 | 33.63 | |
| LLaMa2-70b-chat2024.08 | 32.75 | |
| QWen2-7B-Ins.shot=3-shot2024.08 | 27.8 | |
| LLaMa3.1-8b-Ins.shot=3-shot2024.08 | 27.15 | |
| LLaMa2-13b-chat2024.08 | 20.13 |