Event Argument Extraction on RAMS RAMS2RAMS
45.77Overall F1Ours (LLaMA)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Ours (LLaMA)Backbone=LLaMA2026.03 | 45.77 | 46.46 | 45.06 | |
| Ours (Qwen)Backbone=Qwen2026.03 | 44.59 | 44.06 | 45.11 | |
| Bart-Gen2026.03 | 38.53 | 39.89 | 37.09 | |
| DEEIA2026.03 | 37.95 | 36.57 | 39.49 | |
| HMPEAE2026.03 | 36.44 | 35.18 | 37.74 | |
| TabEAE2026.03 | 36.22 | 37.16 | 35.26 | |
| SCPRG2026.03 | 33.58 | 38.93 | 26.97 | |
| TSAR2026.03 | 30.9 | 38.1 | 21.56 | |
| PAIE2026.03 | 30.8 | 32.52 | 28.87 | |
| EEQA2026.03 | 26.86 | 26.75 | 26.99 | |
| DS-R1CoT=false2026.03 | 24.41 | — | — | |
| DS-R1CoT=true2026.03 | 23.47 | — | — | |
| DS-V3CoT=false2026.03 | 22 | — | — | |
| LLaMA-3.1CoT=false2026.03 | 20.56 | — | — | |
| GPT-4oCoT=false2026.03 | 19.64 | — | — | |
| MixtralCoT=false2026.03 | 19.35 | — | — | |
| Distar2026.03 | 18.98 | 18.26 | 19.68 | |
| GPT-4oCoT=true2026.03 | 18.36 | — | — | |
| LLaMA-3.1CoT=true2026.03 | 17.05 | — | — | |
| MixtralCoT=true2026.03 | 15.96 | — | — | |
| DS-V3CoT=true2026.03 | 15.24 | — | — | |
| Gemma-1.1CoT=false2026.03 | 13.39 | — | — | |
| Phi-4CoT=true2026.03 | 12.89 | — | — | |
| ZSTL2026.03 | 12.24 | — | — | |
| Phi-4CoT=false2026.03 | 10.1 | — | — | |
| Gemma-1.1CoT=true2026.03 | 5.94 | — | — |