Idiom Detection on Idiom Detection IT (test)
79.5AccuracyPrompt mT5
Evaluation Results
| Method | Links | |
|---|---|---|
| Prompt mT5Setting=Zero-shot with EN model, Training Strategy=Multi-task2023.05 | 79.5 | |
| Prompt mT5Setting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 76.5 | |
| Vanilla mT5Setting=Main results, Training Strategy=Single-task2023.05 | 76 | |
| Prompt mT5Setting=Main results, Training Strategy=Multi-task2023.05 | 76 | |
| Prompt mT5Setting=Main results, Training Strategy=Single-task2023.05 | 75 | |
| Vanilla mT5Setting=Main results, Training Strategy=Multi-task2023.05 | 72 | |
| mBERTSetting=Main results, Training Strategy=Single-task2023.05 | 70.5 | |
| Vanilla mT5Setting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 70.5 | |
| Vanilla mT5Setting=Zero-shot with EN model, Training Strategy=Multi-task2023.05 | 63.5 | |
| mBERTSetting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 60 |