Idiom Detection on Idiom Detection DE (test)
79AccuracyPrompt mT5
Evaluation Results
| Method | Links | |
|---|---|---|
| Prompt mT5Setting=Main results, Training Strategy=Multi-task2023.05 | 79 | |
| Prompt mT5Setting=Main results, Training Strategy=Single-task2023.05 | 75 | |
| Vanilla mT5Setting=Main results, Training Strategy=Single-task2023.05 | 74.5 | |
| Vanilla mT5Setting=Main results, Training Strategy=Multi-task2023.05 | 74.5 | |
| mBERTSetting=Main results, Training Strategy=Single-task2023.05 | 72.5 | |
| Prompt mT5Setting=Zero-shot with EN model, Training Strategy=Multi-task2023.05 | 65.6 | |
| mBERTSetting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 62 | |
| Prompt mT5Setting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 59 | |
| Vanilla mT5Setting=Zero-shot with EN model, Training Strategy=Single-task2023.05 | 53 | |
| Vanilla mT5Setting=Zero-shot with EN model, Training Strategy=Multi-task2023.05 | 52.5 |