# Event Argument Extraction on WikiEvents RAMS2Wiki Source: [Event Argument Extraction on WikiEvents RAMS2Wiki]() Collection index: [llms.txt]() Data updated: 2026-03-04T20:29:42.897Z Evaluation of Event Argument Extraction performance on the WikiEvents RAMS2Wiki dataset, measured using Seen Roles F1, Unseen Roles F1, and Overall F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Event Argument Extraction | | Dataset (including any stated split) | WikiEvents RAMS2Wiki | | Metric | Overall F1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 26 of 26 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Overall F1](): Higher is better; unit: PERCENT. - [Seen Roles F1](): Higher is better; unit: PERCENT. - [Unseen Roles F1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Overall F1 | Result date | Report paper | | --- | --- | --- | --- | | Ours (LLaMA) | 32.38 | Not recorded | 69a7bc802d603e6de3e3d49e | | Ours (Qwen) | 31.18 | Not recorded | 69a7bc802d603e6de3e3d49e | | Bart-Gen | 28.52 | Not recorded | 69a7bc802d603e6de3e3d49e | | TabEAE | 26.74 | Not recorded | 69a7bc802d603e6de3e3d49e | | HMPEAE | 25.61 | Not recorded | 69a7bc802d603e6de3e3d49e | | PAIE | 20.15 | Not recorded | 69a7bc802d603e6de3e3d49e | | EEQA | 18.24 | Not recorded | 69a7bc802d603e6de3e3d49e | | DS-R1 | 12.27 | Not recorded | 69a7bc802d603e6de3e3d49e | | TSAR | 11.71 | Not recorded | 69a7bc802d603e6de3e3d49e | | DS-V3 | 10.89 | Not recorded | 69a7bc802d603e6de3e3d49e | | Distar | 10.6 | Not recorded | 69a7bc802d603e6de3e3d49e | | GPT-4o | 10.17 | Not recorded | 69a7bc802d603e6de3e3d49e | | SCPRG | 9.4 | Not recorded | 69a7bc802d603e6de3e3d49e | | ZSTL | 9.4 | Not recorded | 69a7bc802d603e6de3e3d49e | | DS-R1 | 9.24 | Not recorded | 69a7bc802d603e6de3e3d49e | | LLaMA-3.1 | 8.37 | Not recorded | 69a7bc802d603e6de3e3d49e | | GPT-4o | 7.98 | Not recorded | 69a7bc802d603e6de3e3d49e | | DS-V3 | 7.63 | Not recorded | 69a7bc802d603e6de3e3d49e | | LLaMA-3.1 | 6.78 | Not recorded | 69a7bc802d603e6de3e3d49e | | Gemma-1.1 | 5.91 | Not recorded | 69a7bc802d603e6de3e3d49e | | DEEIA | 5.12 | Not recorded | 69a7bc802d603e6de3e3d49e | | Mixtral | 4.81 | Not recorded | 69a7bc802d603e6de3e3d49e | | Mixtral | 4.7 | Not recorded | 69a7bc802d603e6de3e3d49e | | Phi-4 | 4.12 | Not recorded | 69a7bc802d603e6de3e3d49e | | Gemma-1.1 | 3.19 | Not recorded | 69a7bc802d603e6de3e3d49e | | Phi-4 | 2.78 | Not recorded | 69a7bc802d603e6de3e3d49e | ### Ours (LLaMA) Overall F1: 32.38. Result ID: 69a896336dbb7075b9515751. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LLaMA"}. This record does not assert independent reproduction. ### Ours (Qwen) Overall F1: 31.18. Result ID: 69a896336dbb7075b9515752. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen"}. This record does not assert independent reproduction. ### Bart-Gen Overall F1: 28.52. Result ID: 69a896336dbb7075b9515741. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TabEAE Overall F1: 26.74. Result ID: 69a896336dbb7075b951573a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### HMPEAE Overall F1: 25.61. Result ID: 69a896336dbb7075b951573c. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### PAIE Overall F1: 20.15. Result ID: 69a896336dbb7075b9515739. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### EEQA Overall F1: 18.24. Result ID: 69a896336dbb7075b951573f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DS-R1 Overall F1: 12.27. Result ID: 69a896336dbb7075b951574f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction. ### TSAR Overall F1: 11.71. Result ID: 69a896336dbb7075b951573d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DS-V3 Overall F1: 10.89. Result ID: 69a896336dbb7075b951574d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction. ### Distar Overall F1: 10.6. Result ID: 69a896336dbb7075b9515742. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-4o Overall F1: 10.17. Result ID: 69a896336dbb7075b951574b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction. ### SCPRG Overall F1: 9.4. Result ID: 69a896336dbb7075b951573e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ZSTL Overall F1: 9.4. Result ID: 69a896336dbb7075b9515740. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DS-R1 Overall F1: 9.24. Result ID: 69a896336dbb7075b9515750. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction. ### LLaMA-3.1 Overall F1: 8.37. Result ID: 69a896336dbb7075b9515749. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction. ### GPT-4o Overall F1: 7.98. Result ID: 69a896336dbb7075b951574c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction. ### DS-V3 Overall F1: 7.63. Result ID: 69a896336dbb7075b951574e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction. ### LLaMA-3.1 Overall F1: 6.78. Result ID: 69a896336dbb7075b951574a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction. ### Gemma-1.1 Overall F1: 5.91. Result ID: 69a896336dbb7075b9515745. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction. ### DEEIA Overall F1: 5.12. Result ID: 69a896336dbb7075b951573b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Mixtral Overall F1: 4.81. Result ID: 69a896336dbb7075b9515748. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction. ### Mixtral Overall F1: 4.7. Result ID: 69a896336dbb7075b9515747. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction. ### Phi-4 Overall F1: 4.12. Result ID: 69a896336dbb7075b9515743. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"false"}. This record does not assert independent reproduction. ### Gemma-1.1 Overall F1: 3.19. Result ID: 69a896336dbb7075b9515746. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction. ### Phi-4 Overall F1: 2.78. Result ID: 69a896336dbb7075b9515744. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CoT":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.