Event Extraction on Security Posts (Crowd Discussions) (test)
83.36Trigger PrecisionSynAT
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SynATTime Cost=16h2026.02 | 83.36 | 81.25 | 82.29 | 81.93 | 79.25 | 80.57 | 77.83 | 82.16 | 79.94 | 81.04 | 80.89 | 80.93 | |
| GPT-3Time Cost=27h2026.02 | 72.44 | 73.15 | 72.79 | 70.15 | 71.26 | 70.7 | 70.75 | 77.16 | 73.82 | 71.11 | 73.86 | 72.44 | |
| MLBiNetTime Cost=17h2026.02 | 71.45 | 67.12 | 69.22 | 70.34 | 69.45 | 69.89 | 67.32 | 75.05 | 70.98 | 69.7 | 70.54 | 70.03 | |
| Structured-Joint+Time Cost=14.5h2026.02 | 70.35 | 74.24 | 72.24 | 64.27 | 69.08 | 66.59 | 63.24 | 78.03 | 75.86 | 65.95 | 73.78 | 71.56 | |
| ED3CTime Cost=7.7h2026.02 | 64.17 | 65.35 | 64.75 | 65.46 | 60.45 | 62.86 | 58.76 | 66.84 | 62.54 | 62.8 | 64.21 | 63.38 |