Domain Classification on MWOZ
88.16AccuracyMIDAS
Evaluation Results
| Method | Links | |
|---|---|---|
| MIDASBackbone=ROBERTa-Base2024.08 | 88.16 | |
| MIDASmodel_description=Our best model2024.08 | 88.16 | |
| MIDASBackbone=BERT-Base2024.08 | 87.93 | |
| ALBERT-Base2024.08 | 86.94 | |
| ROBERTa-Base2024.08 | 86.75 | |
| BERT-Base2024.08 | 86.67 | |
| GPT4o+2024.08 | 79.41 | |
| GPT4o2024.08 | 78.77 | |
| GPT3.52024.08 | 77.39 | |
| Gemma-7b2024.08 | 72.27 | |
| LLaMa2-70b-chat2024.08 | 69.87 | |
| LLaMa2-7b-chat2024.08 | 65.28 | |
| QWen2-7B-Ins.shot=3-shot2024.08 | 64.16 | |
| LLaMa3.1-8b-Ins.shot=3-shot2024.08 | 59.73 | |
| LLaMa2-13b-chat2024.08 | 56.02 | |
| Tri-level JNLU2024.08 | 25.72 |