Relation Extraction on NYT10 subset (test)
81.5PrecisionHRL
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HRL2018.11 | 81.5 | 47.5 | 60 | |
| TPLinkerEvaluation Match=Partial, Implementation Source=Re-implementation2021.05 | 81.19 | 65.41 | 72.45 | |
| TPLinkerEvaluation Match=Exact, Implementation Source=Re-implementation2021.05 | 80.34 | 65.11 | 71.93 | |
| CasRelEvaluation Match=Partial, Implementation Source=Re-implementation2021.05 | 77.7 | 68.8 | 73 | |
| REREEvaluation Match=Partial2021.05 | 75.45 | 72.5 | 73.95 | |
| CasRelEvaluation Match=Exact, Implementation Source=Re-implementation2021.05 | 75.12 | 65.72 | 70.11 | |
| REREEvaluation Match=Exact2021.05 | 74.9 | 71.97 | 73.4 | |
| HRL2018.11 | 71.4 | 58.6 | 64.4 | |
| HRLEvaluation Match=Partial, Implementation Source=Quoted from Wei et al. (2020)2021.05 | 71.4 | 58.6 | 64.4 | |
| Tagging2018.11 | 59.3 | 38.1 | 46.4 | |
| NovelTaggingEvaluation Match=Partial, Implementation Source=Quoted from Wei et al. (2020)2021.05 | 59.3 | 38.1 | 46.4 | |
| CopyR2018.11 | 56.9 | 45.2 | 50.4 | |
| CopyREvaluation Match=Partial, Implementation Source=Quoted from Wei et al. (2020)2021.05 | 56.9 | 45.2 | 50.4 | |
| RERE-LSTMEvaluation Match=Partial, Backbone=LSTM2021.05 | 56.71 | 42 | 48.26 | |
| SPTree2018.11 | 49.2 | 55.7 | 52.2 | |
| SPTreeEvaluation Match=Partial, Implementation Source=Quoted from Wei et al. (2020)2021.05 | 49.2 | 55.7 | 52.2 | |
| CopyR2018.11 | 39.2 | 26.3 | 31.5 | |
| KB MatchEvaluation Match=Partial2021.05 | 38.1 | 32.38 | 34.97 | |
| SPTree2018.11 | 27.2 | 31.5 | 29.2 | |
| Tagging2018.11 | 25.6 | 23.7 | 24.6 |