# Event Argument Extraction on WikiEvents Wiki2Wiki

Source: [Event Argument Extraction on WikiEvents Wiki2Wiki](<https://www.sota2.com/research/sota/event-argument-extraction-on-wikievents-wiki2wiki>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-04T20:29:42.930Z

Evaluation of Event Argument Extraction performance on the WikiEvents Wiki2Wiki dataset, reporting F1 scores for seen roles, unseen roles, and overall performance.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Event Argument Extraction |
| Dataset (including any stated split) | WikiEvents Wiki2Wiki |
| Metric | Overall F1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 26 of 26 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Overall F1](<https://www.sota2.com/research/sota/event-argument-extraction-on-wikievents-wiki2wiki.md?metric=Overall%20F1>): Higher is better; unit: PERCENT.

- [F1 (Seen Roles)](<https://www.sota2.com/research/sota/event-argument-extraction-on-wikievents-wiki2wiki.md?metric=F1%20(Seen%20Roles)>): Higher is better; unit: PERCENT.

- [F1 (Unseen Roles)](<https://www.sota2.com/research/sota/event-argument-extraction-on-wikievents-wiki2wiki.md?metric=F1%20(Unseen%20Roles)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Overall F1 | Result date | Report paper |
| --- | --- | --- | --- |
| Ours (Qwen) | 47.62 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Ours (LLaMA) | 46.96 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Bart-Gen | 40.82 | Not recorded | 69a7bc802d603e6de3e3d49e |
| TabEAE | 30.97 | Not recorded | 69a7bc802d603e6de3e3d49e |
| HMPEAE | 30.2 | Not recorded | 69a7bc802d603e6de3e3d49e |
| PAIE | 24.42 | Not recorded | 69a7bc802d603e6de3e3d49e |
| DEEIA | 22.51 | Not recorded | 69a7bc802d603e6de3e3d49e |
| SCPRG | 21.9 | Not recorded | 69a7bc802d603e6de3e3d49e |
| EEQA | 21.5 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Distar | 17.51 | Not recorded | 69a7bc802d603e6de3e3d49e |
| TSAR | 13.95 | Not recorded | 69a7bc802d603e6de3e3d49e |
| DS-R1 | 12.84 | Not recorded | 69a7bc802d603e6de3e3d49e |
| DS-V3 | 11.6 | Not recorded | 69a7bc802d603e6de3e3d49e |
| GPT-4o | 11.36 | Not recorded | 69a7bc802d603e6de3e3d49e |
| LLaMA-3.1 | 10.55 | Not recorded | 69a7bc802d603e6de3e3d49e |
| DS-R1 | 10.4 | Not recorded | 69a7bc802d603e6de3e3d49e |
| ZSTL | 9.97 | Not recorded | 69a7bc802d603e6de3e3d49e |
| GPT-4o | 9.65 | Not recorded | 69a7bc802d603e6de3e3d49e |
| LLaMA-3.1 | 8.87 | Not recorded | 69a7bc802d603e6de3e3d49e |
| DS-V3 | 8.62 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Phi-4 | 7.3 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Mixtral | 6.34 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Gemma-1.1 | 6.31 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Mixtral | 6.23 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Phi-4 | 5.78 | Not recorded | 69a7bc802d603e6de3e3d49e |
| Gemma-1.1 | 4.78 | Not recorded | 69a7bc802d603e6de3e3d49e |

### Ours (Qwen)

Overall F1: 47.62. Result ID: 69a896336dbb7075b951576c.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

Recorded evaluation configuration: {"Backbone":"Qwen"}. This record does not assert independent reproduction.

### Ours (LLaMA)

Overall F1: 46.96. Result ID: 69a896336dbb7075b951576b.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA"}. This record does not assert independent reproduction.

### Bart-Gen

Overall F1: 40.82. Result ID: 69a896336dbb7075b951575b.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69bd1e209131cea23ea6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TabEAE

Overall F1: 30.97. Result ID: 69a896336dbb7075b9515754.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f8d1e209131cea462f4.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HMPEAE

Overall F1: 30.2. Result ID: 69a896336dbb7075b9515756.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PAIE

Overall F1: 24.42. Result ID: 69a896336dbb7075b9515753.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c1a1e209131cea3237d.md>)

[Implementation](<https://github.com/mayubo2333/PAIE>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DEEIA

Overall F1: 22.51. Result ID: 69a896336dbb7075b9515755.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73b21e209131cea5df92.md>)

[Implementation](<https://github.com/LWL-cpu/DEEIA>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SCPRG

Overall F1: 21.9. Result ID: 69a896336dbb7075b9515758.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e91e209131cea4de83.md>)

[Implementation](<https://github.com/LWL-cpu/SCPRG-master>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### EEQA

Overall F1: 21.5. Result ID: 69a896336dbb7075b9515759.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa693a1e209131cea21007.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Distar

Overall F1: 17.51. Result ID: 69a896336dbb7075b951575c.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TSAR

Overall F1: 13.95. Result ID: 69a896336dbb7075b9515757.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7a1e209131cea342cb.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DS-R1

Overall F1: 12.84. Result ID: 69a896336dbb7075b9515769.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a91e209131cea6e3eb.md>)

Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction.

### DS-V3

Overall F1: 11.6. Result ID: 69a896336dbb7075b9515767.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction.

### GPT-4o

Overall F1: 11.36. Result ID: 69a896336dbb7075b9515765.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727a1e209131cea56a1e.md>)

[Implementation](<https://github.com/openai/evals>)

Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction.

### LLaMA-3.1

Overall F1: 10.55. Result ID: 69a896336dbb7075b9515763.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction.

### DS-R1

Overall F1: 10.4. Result ID: 69a896336dbb7075b951576a.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a91e209131cea6e3eb.md>)

Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction.

### ZSTL

Overall F1: 9.97. Result ID: 69a896336dbb7075b951575a.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-4o

Overall F1: 9.65. Result ID: 69a896336dbb7075b9515766.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727a1e209131cea56a1e.md>)

[Implementation](<https://github.com/openai/evals>)

Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction.

### LLaMA-3.1

Overall F1: 8.87. Result ID: 69a896336dbb7075b9515764.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction.

### DS-V3

Overall F1: 8.62. Result ID: 69a896336dbb7075b9515768.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction.

### Phi-4

Overall F1: 7.3. Result ID: 69a896336dbb7075b951575d.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76241e209131cea6b756.md>)

Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction.

### Mixtral

Overall F1: 6.34. Result ID: 69a896336dbb7075b9515761.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71d01e209131cea5317b.md>)

[Implementation](<https://github.com/mistralai/mistral-src>)

Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction.

### Gemma-1.1

Overall F1: 6.31. Result ID: 69a896336dbb7075b951575f.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f11e209131cea5973c.md>)

Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction.

### Mixtral

Overall F1: 6.23. Result ID: 69a896336dbb7075b9515762.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71d01e209131cea5317b.md>)

[Implementation](<https://github.com/mistralai/mistral-src>)

Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction.

### Phi-4

Overall F1: 5.78. Result ID: 69a896336dbb7075b951575e.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76241e209131cea6b756.md>)

Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction.

### Gemma-1.1

Overall F1: 4.78. Result ID: 69a896336dbb7075b9515760.

[Reporting paper](<https://www.sota2.com/research/paper/69a7bc802d603e6de3e3d49e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f11e209131cea5973c.md>)

Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.