Entity Typing on OntoNotes (test)
85.44Ma-F1MLMET
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MLMET2021.06 | 85.44 | 67.44 | 80.35 | |
| LRN w/o IREncoder=BERT, Augmentation=with2021.09 | 84.8 | 66.1 | 80.1 | |
| DenoiseETBackbone=ELMo, Augmentation=Yes (ours), Denoising=filter & relabel2019.05 | 84.5 | 63.9 | 78.9 | |
| DenoiseETBackbone=ELMo, Augmentation=provided by Choi et al. (2018)2019.05 | 84.5 | 64.9 | 79.2 | |
| LDET2021.06 | 84.5 | 64.9 | 79.2 | |
| Onoe and DurrettEncoder=ELMo, Augmentation=with, additional features=true2021.09 | 84.5 | 64.9 | 79.2 | |
| LRNEncoder=BERT, Augmentation=with2021.09 | 84.5 | 64.5 | 79.3 | |
| BERT [in-house]Encoder=BERT, Augmentation=with2021.09 | 83.4 | 62.2 | 78.8 | |
| DSAM2021.06 | 83.07 | 66.06 | 78.19 | |
| Lin and Ji (2019)large-scale augmented data=true2021.01 | 82.9 | — | 77.3 | |
| LTRFET2021.06 | 82.9 | 63.8 | 77.3 | |
| Lin and JiEncoder=ELMo, Augmentation=with2021.09 | 82.9 | 63.8 | 77.3 | |
| Wang et al.Encoder=BERT, Augmentation=with2021.09 | 81.8 | 61.1 | 76.3 | |
| BERT-Direct2021.06 | 80.84 | 63.25 | 75.9 | |
| LABELGCN2019.05 | 77.8 | 59.6 | 72.2 | |
| Xiong et al.Encoder=LSTM, Augmentation=with2021.09 | 77.8 | 59.6 | 72.2 | |
| LRNEncoder=BERT, Augmentation=without2021.09 | 77.6 | 56.6 | 71.8 | |
| Box2021.01 | 77.3 | — | 70.9 | |
| LRN w/o IREncoder=BERT, Augmentation=without2021.09 | 77.3 | 55.3 | 70.4 | |
| Choi et al. (2018)2019.05 | 76.8 | 59.5 | 71.8 | |
| UFET2021.06 | 76.8 | 59.5 | 71.8 | |
| Choi et al.Encoder=LSTM, Augmentation=with2021.09 | 76.8 | 59.5 | 71.8 | |
| BERT-Base, UncasedBackbone=BERT-Base2019.05 | 76.6 | 51.8 | 69.1 | |
| Onoe and DurrettEncoder=BERT, Augmentation=without2021.09 | 76.6 | 51.8 | 69.1 | |
| BERT [in-house]Encoder=BERT, Augmentation=without2021.09 | 76.6 | 51.5 | 69.7 | |
| DenoiseETBackbone=ELMo, Augmentation=Yes (ours)2019.05 | 76.5 | 59.3 | 70.7 | |
| Vector2021.01 | 76.2 | — | 68.9 | |
| López and StrubeEncoder=HYPER, Augmentation=with2021.09 | 75.8 | 47.4 | 69.4 | |
| Chen et al. (2020) (undefined)2021.01 | 73 | — | 68.1 | |
| Chen et al.Encoder=ELMo, Augmentation=without2021.09 | 73 | 58.7 | 68.1 | |
| DenoiseETBackbone=ELMo, Augmentation=None2019.05 | 72.7 | 42.7 | 66.7 | |
| Onoe and DurrettEncoder=ELMo, Augmentation=without, additional features=true2021.09 | 72.7 | 42.7 | 66.7 | |
| Chen et al. (2020) (exclusive)2021.01 | 72.4 | — | 67.2 | |
| Zhang et al. (2018)2021.01 | 72.1 | — | 66.5 | |
| PLE2019.05 | 71.5 | 57.2 | 66.1 | |
| AFET2019.05 | 71.1 | 55.1 | 64.7 | |
| Shimaoka et al. (2017)2019.05 | 70.9 | 51.7 | 64.9 |