Event Extraction on CASIE
68.98F1 ScoreBERT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BERTEvaluation Protocol=Supervised2024.11 | 68.98 | — | — | — | |
| BERTSetting=Supervised2024.11 | 68.98 | — | — | — | |
| GoLLIEModel size=34B, Zero-shot=true2023.10 | 65.5 | — | — | — | |
| KnowCoder-XEvaluation Protocol=Supervised2024.11 | 63.91 | — | — | — | |
| KnowCoder-XSetting=Supervised2024.11 | 63.91 | — | — | — | |
| YAYI-UIEEvaluation Protocol=Supervised2024.11 | 63 | — | — | — | |
| YAYI-UIESetting=Supervised2024.11 | 63 | — | — | — | |
| GoLLIEModel size=13B, Zero-shot=true2023.10 | 62.2 | — | — | — | |
| IEPILEEvaluation Protocol=Supervised2024.11 | 60.07 | — | — | — | |
| IEPILESetting=Supervised2024.11 | 60.07 | — | — | — | |
| GoLLIEModel size=7B, Zero-shot=true2023.10 | 59.3 | — | — | — | |
| GoLLIEZero-shot=true2024.03 | 59.3 | — | — | — | |
| KnowCoderZero-shot=true, Model Size=7B2024.03 | 58.2 | — | — | — | |
| GoLLIEModel variant=Baseline, Zero-shot=true2023.10 | 33.9 | — | — | — | |
| baselineModel=Llama-3-8B-Instruct2026.02 | — | — | — | 62.73 | |
| baseline2026.02 | — | — | — | 76.4 | |
| E2HModel Scale=base2023.05 | — | 68.45 | 60.4 | — | |
| E2HModel Scale=large2023.05 | — | 69.58 | 61.96 | — | |
| Full RAGModel=Llama-3-8B-Instruct2026.02 | — | — | — | 82.73 | |
| Full RAG2026.02 | — | — | — | 84.2 | |
| gold shotModel=Llama-3-8B-Instruct2026.02 | — | — | — | 65.53 | |
| gold shot2026.02 | — | — | — | 76.73 | |
| Lu et al. (2021)Type=Comparable SOTA2022.03 | — | 67.51 | 59.45 | — | |
| SELBackbone=T5-v1.1-large, Pre-training=None2022.03 | — | 68.98 | 60.37 | — | |
| T5Model Scale=base2023.05 | — | 68.4 | 60.19 | — | |
| T5Model Scale=large2023.05 | — | 69.29 | 60.98 | — | |
| UCPOFModel=Llama-3-8B-Instruct2026.02 | — | — | — | 81.73 | |
| UCPOF2026.02 | — | — | — | 85.4 | |
| UIEBackbone=T5-v1.1-large, Pre-training=Large-scale structure-text data2022.03 | — | 69.33 | 61.3 | — | |
| UIEPre-training (large-scale continued)=true2023.05 | — | 69.33 | 61.3 | — | |
| UIENumber of Parameters=770M, Backbone=T5-large2023.05 | — | 68.98 | 60.37 | — | |
| UniEXNumber of Parameters=372M, Backbone=RoBERTa-large2023.05 | — | 71.46 | 62.91 | — |