Idiom Detection on Idiom Detection EN (test)
86AccuracyPrompt mT5
Evaluation Results
| Method | Links | |
|---|---|---|
| Prompt mT5Setting=Main results, Training Strategy=Multi-task2023.05 | 86 | |
| Prompt mT5Setting=Zero-shot with EN model, Training Strategy=Multi-task2023.05 | 81.5 | |
| Vanilla mT5Setting=Main results, Training Strategy=Single-task2023.05 | 79.5 | |
| Prompt mT5Setting=Main results, Training Strategy=Single-task2023.05 | 79.5 | |
| Vanilla mT5Setting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 79.5 | |
| Prompt mT5Setting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 79.5 | |
| mBERTSetting=Main results, Training Strategy=Single-task2023.05 | 79 | |
| mBERTSetting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 79 | |
| Vanilla mT5Setting=Zero-shot with EN model, Training Strategy=Multi-task2023.05 | 72.5 | |
| Vanilla mT5Setting=Main results, Training Strategy=Multi-task2023.05 | 62 |