Entity Typing on Ultra-Fine Entity Typing (test)
59.3PrecisionPL-BERT-LARGE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PL-BERT-LARGEBackbone=BERT-large, NPCRF=false2022.12 | 59.3 | 42.6 | 49.6 | |
| PL-BERT-BASEBackbone=BERT-base, NPCRF=false2022.12 | 57.8 | 40.7 | 47.7 | |
| DenoiseETRepresentation=ELMo, Data Augmentation=None2019.05 | 55.8 | 27.7 | 37 | |
| DFETBackbone=PL-BERT2022.12 | 55.6 | 44.7 | 49.5 | |
| DenoiseETRepresentation=ELMo, Data Augmentation=Naive2019.05 | 55.5 | 26.3 | 35.7 | |
| PL-BERT-LARGE W/ NPCRFBackbone=BERT-large, NPCRF=true2022.12 | 55.3 | 46.7 | 50.6 | |
| LRNBackbone=Bert-base2022.12 | 54.5 | 38.9 | 45.4 | |
| MLMETBackbone=Bert-base, Distant supervision/additional pretraining=true2022.12 | 53.6 | 45.3 | 49.1 | |
| Vectormodel_type=vector-based2021.01 | 53 | 36.3 | 43.1 | |
| Boxmodel_type=box-based2021.01 | 52.8 | 38.8 | 44.8 | |
| BOX4TYPESBackbone=Bert-large, Distant supervision/additional pretraining=true2022.12 | 52.8 | 38.8 | 44.8 | |
| LITE+NLI+LBackbone=RoBERTa-large, NLI pretraining=true, Distant supervision/additional pretraining=true2022.12 | 52.4 | 48.9 | 50.6 | |
| PL-BERT-BASE W/ NPCRFBackbone=BERT-base, NPCRF=true2022.12 | 52.1 | 47.5 | 49.7 | |
| BERT-Base, Uncased2019.05 | 51.6 | 33 | 40.2 | |
| BERT-base2021.01 | 51.6 | 33 | 40.2 | |
| DenoiseETRepresentation=ELMo, Data Augmentation=Denoising (Filter & Relabel)2019.05 | 51.5 | 33 | 40.2 | |
| ELMo2021.01 | 51.5 | 33 | 40.2 | |
| LDETDistant supervision/additional pretraining=true2022.12 | 51.5 | 33 | 40.1 | |
| LABELGCN-ROBERTABackbone=RoBERTa-large, NPCRF=false2022.12 | 51.2 | 41 | 45.5 | |
| LABELGCN2019.05 | 50.3 | 29.2 | 36.9 | |
| Label GCN2021.01 | 50.3 | 29.2 | 36.9 | |
| LABELGCNDistant supervision/additional pretraining=true, Modeling label correlations=true2022.12 | 50.3 | 29.2 | 36.9 | |
| LITE+LBackbone=RoBERTa-large, NLI pretraining=false2022.12 | 48.7 | 45.8 | 47.2 | |
| MLC-ROBERTA W/ NPCRFBackbone=RoBERTa-large, NPCRF=true2022.12 | 48.7 | 45.5 | 47 | |
| LABELGCN-ROBERTA W/ NPCRFBackbone=RoBERTa-large, NPCRF=true2022.12 | 48.7 | 45.9 | 47.3 | |
| UFET-BILSTMDistant supervision/additional pretraining=true2022.12 | 48.1 | 23.2 | 31.3 | |
| MLC-ROBERTABackbone=RoBERTa-large, NPCRF=false2022.12 | 47.8 | 40.4 | 43.8 | |
| DenoiseETRepresentation=GloVe, Data Augmentation=None2019.05 | 47.6 | 23.3 | 31.3 | |
| Choi et al. (2018)Data Augmentation=Yes2019.05 | 47.1 | 24.2 | 32 | |
| Choi et al. (2018)2021.01 | 47.1 | 24.2 | 32 |