Open Information Extraction on Re-OIE 2016 (test)
74.6AUCMulti²OIE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Multi²OIEBackbone=BERT, Attention=Multi-head2020.09 | 74.6 | 83.9 | 86.9 | 81 | |
| BERT+BiLSTMBackbone=BERT, Decoder=BiLSTM2020.09 | 72.1 | 81.3 | 86 | 77 | |
| BIOTagging=BIO tagging2020.09 | 71.9 | 80.3 | 84.1 | 76.8 | |
| BIO+MHTagging=BIO tagging, Attention=Multi-head2020.09 | 71.3 | 81.5 | 87 | 76.6 | |
| RnnOIE2020.09 | 68.3 | 78.7 | 84.2 | 73.9 | |
| SpanOIE+MHTagging=Span selection, Attention=Multi-head2020.09 | 68 | 78.8 | 83.1 | 74.9 | |
| SpanOIE2019.01 | 65.9 | 78.5 | — | — | |
| SpanOIETagging=Span selection2020.09 | 65.8 | 77 | 79.7 | 74.5 | |
| SpanOIE_prevtraining_source=OpenIE4 extractions with confidence score > 0.92019.01 | 64.7 | 78.08 | — | — | |
| BIO2019.01 | 57.9 | 77.08 | — | — | |
| OpenIE42019.01 | 50.9 | 68.32 | — | — | |
| OpenIE42020.09 | 50.9 | 68.3 | — | — | |
| ClausIE2019.01 | 46.4 | 64.17 | — | — | |
| ClausIE2020.09 | 46.4 | 64.2 | — | — | |
| PropS2019.01 | 43.3 | 64.16 | — | — | |
| PropS2020.09 | 43.3 | 64.2 | — | — | |
| OLLIE2019.01 | 31.3 | 49.47 | — | — | |
| OLLIE2020.09 | 31.3 | 49.5 | — | — | |
| Stanford2019.01 | 11.5 | 16.7 | — | — | |
| Stanford2020.09 | 11.5 | 16.7 | — | — |