Named Entity Recognition on CoNLL KB-Matching 2003 (test)
94.6F1 ScoreExisting SOTA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Existing SOTASupervision Type=Fully Supervised2022.03 | 94.6 | — | — | |
| RoBERTa-baseSupervision=Supervised2021.06 | 91.12 | — | — | |
| BERTSupervision Type=Fully Supervised2022.03 | 89.03 | 88 | 90.08 | |
| BiLSTMSupervision Type=Fully Supervised2022.03 | 86.19 | 84.06 | 88.42 | |
| BiLSTM-CRFSupervision=Supervised2021.06 | 85.98 | — | — | |
| PU-Learning + BA + CIRSupervision=Distant, backdoor adjustment=true, causal invariance regularizer=true2021.06 | 81.96 | — | — | |
| BOND + BA + CIRSupervision=Distant, backdoor adjustment=true, causal invariance regularizer=true2021.06 | 81.54 | — | — | |
| PU-Learning + BASupervision=Distant, backdoor adjustment=true2021.06 | 80.93 | — | — | |
| BOND + BASupervision=Distant, backdoor adjustment=true2021.06 | 80.81 | — | — | |
| Conf-MPUSupervision Type=Distantly Supervised, Backbone=BiLSTM2022.03 | 80.02 | 77.39 | 82.84 | |
| BONDSupervision=Distant2021.06 | 79.83 | — | — | |
| Conf-MPUSupervision Type=Distantly Supervised, Backbone=BERT2022.03 | 79.16 | 78.58 | 79.75 | |
| RoBERTa-base + BA + CIRSupervision=Distant, backdoor adjustment=true, causal invariance regularizer=true2021.06 | 78.78 | — | — | |
| BNPUSupervision Type=Distantly Supervised, Backbone=BiLSTM2022.03 | 78.44 | 74.38 | 82.97 | |
| RoBERTa-base + BASupervision=Distant, backdoor adjustment=true2021.06 | 76.43 | — | — | |
| RoBERTa-baseSupervision=Distant2021.06 | 76.04 | — | — | |
| PU-LearningSupervision=Distant2021.06 | 74.96 | — | — | |
| BERT-ESSupervision Type=Distantly Supervised, Backbone=BERT2022.03 | 72.15 | 81.38 | 64.8 | |
| DictMatchSupervision=Distant2021.06 | 71.4 | — | — | |
| Dict/KB MatchingSupervision Type=Distantly Supervised2022.03 | 71.4 | 81.13 | 63.75 | |
| MPUSupervision Type=Distantly Supervised, Backbone=BiLSTM2022.03 | 69.13 | 59.46 | 82.54 | |
| AutoNERSupervision Type=Distantly Supervised2022.03 | 67.8 | 73.1 | 63.22 | |
| MPUSupervision Type=Distantly Supervised, Backbone=BERT2022.03 | 65.75 | 58.79 | 74.58 | |
| BiLSTM-CRFSupervision=Distant2021.06 | 64.62 | — | — |