Intent Detection on MWOZ
85.02AccuracyMIDAS
Evaluation results
| Method | Links | |
|---|---|---|
| MIDASBackbone=ROBERTa-Base2024.08 | 85.02 | |
| MIDASmodel_description=Our best model2024.08 | 85.02 | |
| MIDASBackbone=BERT-Base2024.08 | 84.64 | |
| ROBERTa-Base2024.08 | 84.24 | |
| Tri-level JNLU2024.08 | 78.49 | |
| GPT4o+2024.08 | 76.14 | |
| GPT3.52024.08 | 69.71 | |
| Slot-Gated2024.08 | 68.83 | |
| GPT4o2024.08 | 67.89 | |
| SeqSeq2024.08 | 66.41 | |
| BERT-Base2024.08 | 65.34 | |
| ALBERT-Base2024.08 | 65.31 | |
| Gemma-7b2024.08 | 65.15 | |
| LLaMa3.1-8b-Ins.shot=3-shot2024.08 | 64.22 | |
| QWen2-7B-Ins.shot=3-shot2024.08 | 54.59 | |
| LLaMa2-7b-chat2024.08 | 47.51 | |
| LLaMa2-70b-chat2024.08 | 38.96 | |
| LLaMa2-13b-chat2024.08 | 16.79 |