Relation Extraction on NYT (test) (AUC/P@K Metrics)
93.9P@100DocDS
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DocDSMethod Category=Doc Based2020.12 | 93.9 | 0.595 | 88.9 | 87.3 | 0.9 | |
| RE-BERTMethod Category=Bag Based (with PLMs)2020.12 | 92 | — | 86 | 82.3 | 0.868 | |
| PCNNMultiAttMethod Category=Bag Based2020.12 | 91.8 | 0.422 | 84 | 78.7 | 0.848 | |
| REDS2Method Category=Bag Based (with knowledge)2020.12 | 82.4 | 0.447 | 79.6 | 76.6 | 0.795 | |
| Bert-Two-StepMethod Category=Doc Based2020.12 | 82 | 0.443 | 75.5 | 71.7 | 0.764 | |
| RESIDEMethod Category=Bag Based (with knowledge)2020.12 | 81.8 | 0.415 | 75.4 | 74.3 | 0.772 | |
| PCNNAttMethod Category=Bag Based2020.12 | 73 | 0.342 | 68 | 67.3 | 0.694 | |
| DISTREMethod Category=Bag Based (with PLMs)2020.12 | 68 | 0.422 | 67 | 65.3 | 0.668 | |
| MintzMethod Category=Naive2020.12 | 52.3 | 0.107 | 50.2 | 45 | 0.492 |