Relation Extraction on Security posts dataset
88.04Precision (AchievedBy)SynAT
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SynATTime Cost=16h2026.02 | 88.04 | 89.17 | 88.6 | 90.19 | 93.08 | 91.61 | 80.04 | 86.67 | 83.22 | 86.09 | 89.64 | 87.81 | |
| GPT-3Time Cost=27h2026.02 | 78.22 | 70.15 | 73.97 | 69.06 | 70.15 | 69.6 | 76.24 | 82.16 | 79.09 | 74.51 | 74.15 | 74.22 | |
| Structured-Joint+Time Cost=14.5h2026.02 | 75.94 | 62.1 | 68.33 | 73.32 | 68.75 | 70.96 | 74.66 | 81.72 | 78.03 | 74.67 | 70.86 | 72.44 | |
| JC LearningTime Cost=16h2026.02 | 68.44 | 63.17 | 65.7 | 71.45 | 62.6 | 66.73 | 71.42 | 70.59 | 71 | 70.44 | 65.45 | 67.81 | |
| KnowledgeILPTime Cost=8.5h2026.02 | 62.06 | 60.45 | 61.24 | 70.33 | 63.44 | 66.71 | 65.87 | 72.13 | 68.86 | 66.09 | 65.34 | 65.6 |