Relation Extraction on Wiki-KBP (test)
47.49F1 ScoreDUAL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DUALRE model=BiGRUs2020.11 | 47.49 | — | — | |
| CASRELMatch Protocol=Exact Match2019.09 | 45.9 | 49.8 | 42.7 | |
| EntThresRE model=BiGRUs2020.11 | 44.7 | — | — | |
| PA-LSTM-CRFMatch Protocol=Exact Match2019.09 | 44.4 | 51.1 | 39.3 | |
| DUALRE model=PaLSTMs2020.11 | 44.2 | — | — | |
| MaxThresRE model=BiGRUs2020.11 | 42.64 | — | — | |
| EntThresRE model=BiLSTMs2020.11 | 42.48 | — | — | |
| BAFixRE model=BiGRUs2020.11 | 42.41 | — | — | |
| ReHessionMatch Protocol=Exact Match2019.09 | 42.1 | 36.7 | 49.3 | |
| DUALRE model=BiLSTMs2020.11 | 42.07 | — | — | |
| BASetRE model=PaLSTMs2020.11 | 40.55 | — | — | |
| BASetRE model=BiLSTMs2020.11 | 40.53 | — | — | |
| MaxThresRE model=BiLSTMs2020.11 | 40.53 | — | — | |
| BAFixRE model=PaLSTMs2020.11 | 40.27 | — | — | |
| EntThresRE model=PaLSTMs2020.11 | 40.18 | — | — | |
| DUALRE model=BERTs2020.11 | 40.13 | — | — | |
| BASetRE model=BiGRUs2020.11 | 39.72 | — | — | |
| DS-OnlyRE model=BiGRUs2020.11 | 39.09 | — | — | |
| CoTypeMatch Protocol=Exact Match2019.09 | 38.8 | 31.1 | 53.7 | |
| DUALRE model=PCNNs2020.11 | 38.72 | — | — | |
| NovelTaggingMatch Protocol=Exact Match2019.09 | 38.7 | 53.6 | 30.3 | |
| BASetRE model=BERTs2020.11 | 38.58 | — | — | |
| MultiRMatch Protocol=Exact Match2019.09 | 38 | 30.1 | 53 | |
| MaxThresRE model=BERTs2020.11 | 37.51 | — | — | |
| CoTypeTime=2.5min2016.10 | 36.9 | 34.8 | 40.6 | |
| MaxThresRE model=PaLSTMs2020.11 | 36.3 | — | — | |
| DS-OnlyRE model=BERTs2020.11 | 36.1 | — | — | |
| BAFixRE model=BiLSTMs2020.11 | 35.81 | — | — | |
| EntThresRE model=BERTs2020.11 | 35.39 | — | — | |
| DS-OnlyRE model=PaLSTMs2020.11 | 35.21 | — | — | |
| DS-OnlyRE model=BiLSTMs2020.11 | 35.19 | — | — | |
| CoType-TwoStepTime=6.1min2016.10 | 34.9 | 34.7 | 35.1 | |
| HA-OnlyRE model=PCNNs2020.11 | 34.1 | — | — | |
| CoType-RMTime=1.5min2016.10 | 34 | 34.2 | 33.9 | |
| BAFixRE model=BERTs2020.11 | 33.83 | — | — | |
| DS+LogisticTime=14min2016.10 | 33.5 | 29.6 | 38.7 | |
| DS+PerceptronTime=7.7min2016.10 | 30.8 | 23.3 | 45.7 | |
| MultiRTime=4.1min2016.10 | 30.1 | 32.5 | 27.8 | |
| FCMTime=25min2016.10 | 30.1 | 15.1 | 50 | |
| LINETime=1.5min2016.10 | 29.9 | 36 | 25.7 | |
| DUALRE model=CNNs2020.11 | 29.69 | — | — | |
| BAFixRE model=PCNNs2020.11 | 29.31 | — | — | |
| EntThresRE model=PCNNs2020.11 | 29.25 | — | — | |
| EntThresRE model=CNNs2020.11 | 28.26 | — | — | |
| MaxThresRE model=PCNNs2020.11 | 28.15 | — | — | |
| DS-OnlyRE model=CNNs2020.11 | 28.1 | — | — | |
| DS-OnlyRE model=PCNNs2020.11 | 27.05 | — | — | |
| MaxThresRE model=CNNs2020.11 | 26.45 | — | — | |
| HA-OnlyRE model=CNNs2020.11 | 25.86 | — | — | |
| BAFixRE model=CNNs2020.11 | 24.73 | — | — | |
| BASetRE model=PCNNs2020.11 | 24.1 | — | — | |
| BASetRE model=CNNs2020.11 | 24 | — | — | |
| HA-OnlyRE model=BiGRUs2020.11 | 19.84 | — | — | |
| HA-OnlyRE model=BiLSTMs2020.11 | 17.87 | — | — | |
| HA-OnlyRE model=BERTs2020.11 | 16.31 | — | — | |
| DeepWalkTime=27min2016.10 | 15 | 10.1 | 29.6 | |
| DS+KernelTime=9.8hr2016.10 | 14.9 | 10.8 | 23.9 | |
| HA-OnlyRE model=PaLSTMs2020.11 | 11.53 | — | — | |
| DS-JointTime=54hr2016.10 | 7.8 | 44.4 | 4.3 |