Entity Mention Detection on ACE05
87.03PrecisionHierarchical Multi-task Model
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Hierarchical Multi-task ModelSetup=(C), Model=EMD2018.11 | 87.03 | 85.27 | 86.14 | |
| Hierarchical Multi-task ModelSetup=(I), Model=NER + EMD + RE2018.11 | 86.63 | 85.9 | 86.26 | |
| Hierarchical Multi-task ModelSetup=(F), Model=NER + EMD2018.11 | 86.54 | 85.49 | 86.02 | |
| Hierarchical Multi-task ModelSetup=(J), Model=NER + EMD + CR2018.11 | 85.89 | 85.86 | 85.87 | |
| Hierarchical Multi-task ModelSetup=(H), Model=EMD + CR2018.11 | 85.84 | 85.46 | 85.65 | |
| Hierarchical Multi-task ModelSetup=(A), Model=Full Model2018.11 | 85.68 | 85.69 | 85.69 | |
| Hierarchical Multi-task ModelSetup=(K), Model=EMD + NER2018.11 | 85.62 | 84.76 | 85.19 | |
| Hierarchical Multi-task ModelSetup=(G), Model=EMD + RE2018.11 | 85.58 | 85.38 | 85.5 | |
| Hierarchical Multi-task ModelSetup=(L), Model=EMD + NER + RE + CR2018.11 | 85.24 | 85.05 | 85.14 | |
| Li and JiModel=Li and Ji 20142018.11 | 85.2 | 76.9 | 80.8 | |
| Katiyar and CardieModel=Katiyar and Cardie 20172018.11 | 84 | 81.3 | 82.6 | |
| Miwa and BansalModel=Miwa and Bansal 20162018.11 | 82.9 | 83.9 | 83.4 | |
| ToMMeRDecoding Strategy=Greedy (flat) decoding, Zero-shot=true, Nested=true, #samples=8 230, #entities=30,7782025.10 | 31.9 | 32.5 | 32.2 | |
| ToMMeRDecoding Strategy=Threshold decoding, Zero-shot=true, Nested=true, #samples=8 230, #entities=30,7782025.10 | 28.7 | 42 | 34.1 |