Event Argument Extraction on WikiEvents RAMS2Wiki
32.38Overall F1Ours (LLaMA)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Ours (LLaMA)Backbone=LLaMA2026.03 | 32.38 | 30.81 | 34.43 | |
| Ours (Qwen)Backbone=Qwen2026.03 | 31.18 | 31.74 | 30.47 | |
| Bart-Gen2026.03 | 28.52 | 24.66 | 33.45 | |
| TabEAE2026.03 | 26.74 | 16.94 | 35.05 | |
| HMPEAE2026.03 | 25.61 | 16.89 | 32.74 | |
| PAIE2026.03 | 20.15 | 19.57 | 31.72 | |
| EEQA2026.03 | 18.24 | 14.74 | 21.39 | |
| DS-R1CoT=false2026.03 | 12.27 | — | — | |
| TSAR2026.03 | 11.71 | 15.77 | 13.37 | |
| DS-V3CoT=false2026.03 | 10.89 | — | — | |
| Distar2026.03 | 10.6 | 13.11 | 3.2 | |
| GPT-4oCoT=false2026.03 | 10.17 | — | — | |
| SCPRG2026.03 | 9.4 | 10.8 | 10 | |
| ZSTL2026.03 | 9.4 | — | — | |
| DS-R1CoT=true2026.03 | 9.24 | — | — | |
| LLaMA-3.1CoT=false2026.03 | 8.37 | — | — | |
| GPT-4oCoT=true2026.03 | 7.98 | — | — | |
| DS-V3CoT=true2026.03 | 7.63 | — | — | |
| LLaMA-3.1CoT=true2026.03 | 6.78 | — | — | |
| Gemma-1.1CoT=false2026.03 | 5.91 | — | — | |
| DEEIA2026.03 | 5.12 | 1.5 | 7.17 | |
| MixtralCoT=true2026.03 | 4.81 | — | — | |
| MixtralCoT=false2026.03 | 4.7 | — | — | |
| Phi-4CoT=false2026.03 | 4.12 | — | — | |
| Gemma-1.1CoT=true2026.03 | 3.19 | — | — | |
| Phi-4CoT=true2026.03 | 2.78 | — | — |