# Event Extraction on CASIE

Source: [Event Extraction on CASIE](<https://www.sota2.com/research/sota/event-extraction-on-casie>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-20T08:02:11.641Z

Evaluation of Event Extraction performance on the CASIE dataset, measured using Event Trigger F1 and Event Argument F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Event Extraction |
| Dataset (including any stated split) | CASIE |
| Metric | F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 Score](<https://www.sota2.com/research/sota/event-extraction-on-casie.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Event Trigger F1](<https://www.sota2.com/research/sota/event-extraction-on-casie.md?metric=Event%20Trigger%20F1>): Higher is better; unit: PERCENT.

- [Event Argument F1](<https://www.sota2.com/research/sota/event-extraction-on-casie.md?metric=Event%20Argument%20F1>): Higher is better; unit: PERCENT.

- [Accuracy](<https://www.sota2.com/research/sota/event-extraction-on-casie.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| BERT | 68.98 | Not recorded | 68fa79061e209131cea7bc57 |
| BERT | 68.98 | Not recorded | 68fa79061e209131cea7bc57 |
| GoLLIE | 65.5 | Not recorded | 68fa72791e209131cea5699b |
| KnowCoder-X | 63.91 | Not recorded | 68fa79061e209131cea7bc57 |
| KnowCoder-X | 63.91 | Not recorded | 68fa79061e209131cea7bc57 |
| YAYI-UIE | 63 | Not recorded | 68fa79061e209131cea7bc57 |
| YAYI-UIE | 63 | Not recorded | 68fa79061e209131cea7bc57 |
| GoLLIE | 62.2 | Not recorded | 68fa72791e209131cea5699b |
| IEPILE | 60.07 | Not recorded | 68fa79061e209131cea7bc57 |
| IEPILE | 60.07 | Not recorded | 68fa79061e209131cea7bc57 |
| GoLLIE | 59.3 | Not recorded | 68fa72791e209131cea5699b |
| GoLLIE | 59.3 | Not recorded | 68fa72851e209131cea56fe5 |
| KnowCoder | 58.2 | Not recorded | 68fa72851e209131cea56fe5 |
| GoLLIE | 33.9 | Not recorded | 68fa72791e209131cea5699b |

### BERT

F1 Score: 68.98. Result ID: 6995bb823badfaffe6bd0f86.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Evaluation Protocol":"Supervised"}. This record does not assert independent reproduction.

### BERT

F1 Score: 68.98. Result ID: 6995bb823badfaffe6bd0fd5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Setting":"Supervised"}. This record does not assert independent reproduction.

### GoLLIE

F1 Score: 65.5. Result ID: 69922bf03a6c3148490d0ffb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Implementation](<https://github.com/hitz-zentroa/GoLLIE>)

Recorded evaluation configuration: {"Model size":"34B","Zero-shot":true}. This record does not assert independent reproduction.

### KnowCoder-X

F1 Score: 63.91. Result ID: 6995bb823badfaffe6bd0f89.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Implementation](<https://github.com/ICT-GoKnow/KnowCoder>)

Recorded evaluation configuration: {"Evaluation Protocol":"Supervised"}. This record does not assert independent reproduction.

### KnowCoder-X

F1 Score: 63.91. Result ID: 6995bb823badfaffe6bd0fd8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Implementation](<https://github.com/ICT-GoKnow/KnowCoder>)

Recorded evaluation configuration: {"Setting":"Supervised"}. This record does not assert independent reproduction.

### YAYI-UIE

F1 Score: 63. Result ID: 6995bb823badfaffe6bd0f87.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c11e209131cea58673.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Supervised"}. This record does not assert independent reproduction.

### YAYI-UIE

F1 Score: 63. Result ID: 6995bb823badfaffe6bd0fd6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c11e209131cea58673.md>)

Recorded evaluation configuration: {"Setting":"Supervised"}. This record does not assert independent reproduction.

### GoLLIE

F1 Score: 62.2. Result ID: 69922bf03a6c3148490d0ffa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Implementation](<https://github.com/hitz-zentroa/GoLLIE>)

Recorded evaluation configuration: {"Model size":"13B","Zero-shot":true}. This record does not assert independent reproduction.

### IEPILE

F1 Score: 60.07. Result ID: 6995bb823badfaffe6bd0f88.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Supervised"}. This record does not assert independent reproduction.

### IEPILE

F1 Score: 60.07. Result ID: 6995bb823badfaffe6bd0fd7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

Recorded evaluation configuration: {"Setting":"Supervised"}. This record does not assert independent reproduction.

### GoLLIE

F1 Score: 59.3. Result ID: 69922bf03a6c3148490d0ff9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Implementation](<https://github.com/hitz-zentroa/GoLLIE>)

Recorded evaluation configuration: {"Model size":"7B","Zero-shot":true}. This record does not assert independent reproduction.

### GoLLIE

F1 Score: 59.3. Result ID: 69925a453a6c3148490e6062.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Implementation](<https://github.com/hitz-zentroa/GoLLIE>)

Recorded evaluation configuration: {"Zero-shot":true}. This record does not assert independent reproduction.

### KnowCoder

F1 Score: 58.2. Result ID: 69925a453a6c3148490e6063.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Implementation](<https://ict-goknow.github.io/knowcoder/>)

Recorded evaluation configuration: {"Zero-shot":true,"Model Size":"7B"}. This record does not assert independent reproduction.

### GoLLIE

F1 Score: 33.9. Result ID: 69922bf03a6c3148490d0ff8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72791e209131cea5699b.md>)

[Implementation](<https://github.com/hitz-zentroa/GoLLIE>)

Recorded evaluation configuration: {"Model variant":"Baseline","Zero-shot":true}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
