Slot Filling on M2M
98.56Micro F1MIDAS
Evaluation results
| Method | Links | |
|---|---|---|
| MIDASBackbone=BERT-Base2024.08 | 98.56 | |
| MIDASmodel_description=Our best model2024.08 | 98.56 | |
| MIDASBackbone=ROBERTa-Base2024.08 | 98.13 | |
| Tri-level JNLU2024.08 | 93.02 | |
| Slot-Gated2024.08 | 92.79 | |
| SeqSeq2024.08 | 91.72 | |
| ROBERTa-Base2024.08 | 91.32 | |
| BERT-Base2024.08 | 85.43 | |
| ALBERT-Base2024.08 | 85.42 | |
| GPT4o+2024.08 | 71.32 | |
| GPT4o2024.08 | 66.16 | |
| GPT3.52024.08 | 55.16 | |
| LLaMa3.1-8b-Ins.shot=3-shot2024.08 | 54.12 | |
| Gemma-7b2024.08 | 43.57 | |
| QWen2-7B-Ins.shot=3-shot2024.08 | 11.92 | |
| LLaMa2-13b-chat2024.08 | 10.92 | |
| LLaMa2-70b-chat2024.08 | 8.83 | |
| LLaMa2-7b-chat2024.08 | 7.51 |