Joint Entity and Relation Extraction on ACE04
86.73Entity F1baseline + AT (vs Li et al.)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| baseline + AT (vs Li et al.)External NLP Tools=false, Evaluation Protocol=Standard2018.08 | 86.73 | — | — | — | — | 75.52 | 81.13 | |
| baseline (vs Li et al.)External NLP Tools=false, Evaluation Protocol=Standard2018.08 | 86.4 | — | — | — | — | 74.58 | 80.49 | |
| Li et al. (2017)External NLP Tools=true, Evaluation Protocol=Standard2018.08 | 84.6 | — | — | — | — | 71.4 | 78 | |
| Miwa & Bansal (2016)Pre-calculated Features=true, Evaluation Protocol=strict2018.04 | 81.8 | 80.8 | 82.9 | 48.7 | 48.1 | 48.4 | 65.1 | |
| Miwa and Bansal (2016)External NLP Tools=true, Evaluation Protocol=Standard2018.08 | 81.8 | — | — | — | — | 48.4 | 65.1 | |
| baseline + ATExternal NLP Tools=false, Evaluation Protocol=Standard2018.08 | 81.64 | — | — | — | — | 47.45 | 64.54 | |
| multi-headPre-calculated Features=false, Evaluation Protocol=strict2018.04 | 81.16 | 81.01 | 81.31 | 50.14 | 44.48 | 47.14 | 64.15 | |
| baselineExternal NLP Tools=false, Evaluation Protocol=Standard2018.08 | 81.16 | — | — | — | — | 47.14 | 64.15 | |
| Katiyar & Cardie (2017)Pre-calculated Features=false, Evaluation Protocol=strict2018.04 | 79.6 | 81.2 | 78.1 | 46.4 | 45.53 | 45.7 | 62.65 | |
| Katiyar and Cardie (2017)External NLP Tools=false, Evaluation Protocol=Standard2018.08 | 79.6 | — | — | — | — | 45.7 | 62.65 | |
| Li et al. (2016)External NLP Tools=true, Evaluation Protocol=Standard2018.08 | 79.5 | — | — | — | — | 63.4 | 71.45 |