Fine-Grained Entity Typing on OntoNotes (test)
86.6Macro F1 ScoreLITE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LITETraining/Evaluation Protocol=pre-trained on NLI+UFET2022.02 | 86.6 | — | — | — | — | — | 81.4 | |
| LITETraining/Evaluation Protocol=NLI+task-specific training2022.02 | 86.4 | — | — | — | — | — | 80.9 | |
| MLMET2022.02 | 85.4 | — | — | — | — | — | 80.4 | |
| MLMETuse hierarchical type structures=false2022.10 | 85.4 | 67.4 | — | — | — | — | 80.4 | |
| denoising enhanced ultra-fine entity typing modeluse hierarchical type structures=false2022.10 | 85.4 | 70 | — | — | — | — | 80.9 | |
| Filter+Relabeluse hierarchical type structures=false2022.10 | 84.5 | 64.9 | — | — | — | — | 79.2 | |
| DSAM2022.02 | 83.1 | — | — | — | — | — | 78.2 | |
| PLE2016.02 | 79.8 | 63.9 | 81.4 | 78.2 | 79.1 | 76.6 | 77.8 | |
| PLE-CoHvariant=cohesion only2016.02 | 78.7 | 62 | 78.9 | 78.5 | 77.8 | 76.9 | 77.3 | |
| LabelGCNuse hierarchical type structures=false2022.10 | 77.8 | 59.6 | — | — | — | — | 72.2 | |
| Box4Types2022.02 | 77.3 | — | — | — | — | — | 70.9 | |
| PLE-NoCovariant=no correlation2016.02 | 77 | 59.3 | 76.8 | 77.3 | 75.1 | 76.2 | 75.6 | |
| Multi-taskuse hierarchical type structures=false2022.10 | 76.8 | 59.5 | — | — | — | — | 71.8 | |
| BERTuse hierarchical type structures=false2022.10 | 76.6 | 51.8 | — | — | — | — | 69.1 | |
| NFETCuse hierarchical type structures=true2022.10 | 76.4 | 60.2 | — | — | — | — | 70.2 | |
| LINE-Rawtraining=raw labels2016.02 | 73.3 | 54.9 | 69.9 | 77 | 67.7 | 75.4 | 71.4 | |
| Hierarchy-Typing2022.02 | 73 | — | — | — | — | — | 68.1 | |
| Raw2016.02 | 72.7 | 48 | 67.1 | 79.3 | 57.6 | 78.6 | 66.5 | |
| Min2016.02 | 72.5 | 48.7 | 68 | 77.7 | 59.2 | 76.3 | 66.7 | |
| Sib2016.02 | 72.1 | 48.1 | 71 | 73.2 | 67.5 | 70.2 | 68.8 | |
| All2016.02 | 72 | 48.7 | 71.6 | 72.4 | 68.6 | 69.1 | 68.9 | |
| PTE-Rawtraining=raw labels2016.02 | 71.9 | 52.9 | 68.7 | 75.4 | 65.7 | 73.3 | 69.3 | |
| LNRuse hierarchical type structures=true2022.10 | 71.5 | 57.2 | — | — | — | — | 66.1 | |
| WSABIE-Rawtraining=raw labels2016.02 | 71.3 | 48.2 | 68.6 | 74.3 | 66.7 | 72.1 | 69.3 | |
| AFETuse hierarchical type structures=true2022.10 | 71.1 | 55.1 | — | — | — | — | 64.7 | |
| AttentiveNERuse hierarchical type structures=true2022.10 | 71 | 51.7 | — | — | — | — | 64.9 | |
| DeepWalk-Rawtraining=raw labels2016.02 | 66.4 | 44.1 | 62.5 | 70.8 | 59.8 | 68.3 | 63.8 |