Event Detection on ACE 2005
74.7F1 ScoreOneIE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OneIEAnnotation level=Token Annotation + Entity Annotation, PLM=BERT-large2021.06 | 74.7 | — | — | — | |
| KnowCoderEvaluation Protocol=Supervised2024.11 | 74.2 | — | — | — | |
| KnowCoder-XEvaluation Protocol=Supervised2024.11 | 73.57 | — | — | — | |
| KnowCoder-XSetting=Supervised2024.11 | 73.57 | — | — | — | |
| OneIE w/o GlobalAnnotation level=Token Annotation + Entity Annotation, PLM=BERT-large2021.06 | 73.5 | — | — | — | |
| Gate + OrderBackbone=CNN2021.06 | 72.6 | 0.002 | — | — | |
| BERTEvaluation Protocol=Supervised2024.11 | 72.5 | — | — | — | |
| BERTSetting=Supervised2024.11 | 72.5 | — | — | — | |
| IEPILEEvaluation Protocol=Supervised2024.11 | 72.46 | — | — | — | |
| IEPILESetting=Supervised2024.11 | 72.46 | — | — | — | |
| EEQAAnnotation level=Token Annotation, PLM=2 x BERT-base2021.06 | 72.4 | — | 71.1 | 73.7 | |
| GAILAnnotation level=Token Annotation + Entity Annotation, PLM=ELMo2021.06 | 72 | — | 74.8 | 69.4 | |
| TEXT2EVENTAnnotation level=Parallel Text-Record Annotation, PLM=T5-large2021.06 | 71.9 | — | 69.6 | 74.4 | |
| MQAEEAnnotation level=Token Annotation, PLM=3 x BERT-large2021.06 | 71.7 | — | — | — | |
| Order LossBackbone=CNN2021.06 | 71.5 | 0.032 | — | — | |
| Gate LossBackbone=CNN2021.06 | 71.4 | 0.044 | — | — | |
| Base LossBackbone=CNN2021.06 | 70.5 | — | — | — | |
| SL (Saliency Learning)Backbone=CNN2021.06 | 70.4 | — | — | — | |
| IGA (IG Attribution)Backbone=CNN2021.06 | 70.3 | — | — | — | |
| BaselineBackbone=CNN2021.06 | 69.8 | — | — | — | |
| Joint3EEAnnotation level=Token Annotation + Entity Annotation2021.06 | 69.8 | — | 68 | 71.8 | |
| DYGIE++Annotation level=Token Annotation + Entity Annotation, PLM=BERT-large2021.06 | 69.7 | — | — | — | |
| TEXT2EVENTAnnotation level=Parallel Text-Record Annotation, PLM=T5-base2021.06 | 69.2 | — | 67.5 | 71.2 | |
| Multi-Task TANLAnnotation level=Token Annotation, PLM=T5-base2021.06 | 68.5 | — | — | — | |
| TANLAnnotation level=Token Annotation, PLM=T5-base2021.06 | 68.4 | — | — | — | |
| YAYI-UIEEvaluation Protocol=Supervised2024.11 | 65 | — | — | — | |
| YAYI-UIESetting=Supervised2024.11 | 65 | — | — | — |