Event Detection on MAVEN (test)
68.8F1 ScoreEvent type name
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Event type nameSetting=Supervised2022.04 | 68.8 | — | — | |
| APEX PromptSetting=Supervised2022.04 | 68.8 | — | — | |
| Seed TriggersSetting=Supervised2022.04 | 68.7 | — | — | |
| SOTA (Wang et al., 2021b)Setting=Supervised2022.04 | 68.5 | — | — | |
| Majority Voting of (a)-(e)Setting=Supervised2022.04 | 68.4 | — | — | |
| APEX PromptSetting=Few-shot2022.04 | 68.4 | — | — | |
| DefinitionSetting=Supervised2022.04 | 67.1 | — | — | |
| Seed TriggersSetting=Few-shot2022.04 | 65.1 | — | — | |
| Continuous Soft PromptSetting=Supervised2022.04 | 64.5 | — | — | |
| APEX PromptSetting=Zero-shot2022.04 | 64.5 | — | — | |
| Event type nameSetting=Few-shot2022.04 | 63.4 | — | — | |
| Majority Voting of (a)-(e)Setting=Few-shot2022.04 | 63.4 | — | — | |
| Seed TriggersSetting=Zero-shot2022.04 | 62.2 | — | — | |
| Event type nameSetting=Zero-shot2022.04 | 58.8 | — | — | |
| Majority Voting of (a)-(e)Setting=Zero-shot2022.04 | 58.6 | — | — | |
| SOTA (Chen et al., 2021)Setting=Few-shot2022.04 | 57 | — | — | |
| DefinitionSetting=Few-shot2022.04 | 56.9 | — | — | |
| DefinitionSetting=Zero-shot2022.04 | 52.9 | — | — | |
| SOTA (Zhang et al., 2021b)Setting=Zero-shot2022.04 | 40.2 | — | — | |
| Continuous Soft PromptSetting=Few-shot2022.04 | 38.6 | — | — | |
| MetaEventshot=zero-shot, way=10-way, backbone=roberta-base2023.05 | 36.86 | 23.52 | 25.69 | |
| ZEOPshot=zero-shot, way=10-way2023.05 | 24.44 | 12.74 | 16.42 | |
| SCCLshot=zero-shot, way=10-way2023.05 | 24.24 | 15.46 | 14.83 | |
| ZEOP*shot=zero-shot, way=10-way, variant=improved2023.05 | 23.83 | 13.66 | 14.84 | |
| SS-VQ-VAEshot=zero-shot, way=10-way2023.05 | 19.34 | 11.92 | 18.38 | |
| BERT-OCLshot=zero-shot, way=10-way2023.05 | 14.46 | 19.15 | 11.6 |