Domain Classification on M2M
89.52AccuracyMIDAS
Evaluation Results
| Method | Links | |
|---|---|---|
| MIDASBackbone=BERT-Base2024.08 | 89.52 | |
| MIDASmodel_description=Our best model2024.08 | 89.52 | |
| MIDASBackbone=ROBERTa-Base2024.08 | 89.45 | |
| Tri-level JNLU2024.08 | 89.38 | |
| BERT-Base2024.08 | 89.23 | |
| ALBERT-Base2024.08 | 89.19 | |
| ROBERTa-Base2024.08 | 89.09 | |
| GPT4o2024.08 | 85.03 | |
| GPT3.52024.08 | 77.4 | |
| GPT4o+2024.08 | 70.51 | |
| QWen2-7B-Ins.shot=3-shot2024.08 | 65.41 | |
| LLaMa2-70b-chat2024.08 | 60.12 | |
| Gemma-7b2024.08 | 54.26 | |
| LLaMa2-7b-chat2024.08 | 52.31 | |
| LLaMa3.1-8b-Ins.shot=3-shot2024.08 | 50.76 | |
| LLaMa2-13b-chat2024.08 | 44.68 |