Nested Mention Detection on ACE2005 (test)
84.33F1 Scoreseq2seq+BERT+Flair
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| seq2seq+BERT+FlairEmbeddings=BERT+Flair2019.08 | 84.33 | — | — | |
| seq2seq+BERTEmbeddings=BERT2019.08 | 83.42 | — | — | |
| seq2seq+ELMo+BERT+FlairEmbeddings=ELMo+BERT+Flair2019.08 | 83.41 | — | — | |
| seq2seq+BERT+ELMoEmbeddings=BERT+ELMo2019.08 | 82.15 | — | — | |
| seq2seq+ELMoEmbeddings=ELMo2019.08 | 81.95 | — | — | |
| LSTM-CRF+BERT+FlairEmbeddings=BERT+Flair2019.08 | 80.82 | — | — | |
| LSTM-CRF+BERT+ELMoEmbeddings=BERT+ELMo2019.08 | 80.04 | — | — | |
| LSTM-CRF+BERTEmbeddings=BERT2019.08 | 79.95 | — | — | |
| LSTM-CRF+ELMo+BERT+FlairEmbeddings=ELMo+BERT+Flair2019.08 | 79.85 | — | — | |
| seq2seq+FlairEmbeddings=Flair2019.08 | 79.83 | — | — | |
| LSTM-CRF+ELMoEmbeddings=ELMo2019.08 | 78.36 | — | — | |
| LSTM-CRF+FlairEmbeddings=Flair2019.08 | 77.25 | — | — | |
| seq2seqEmbeddings=Standard2019.08 | 75.36 | — | — | |
| Anchor-Region Networksmax mention length (c)=n, Time Complexity=O(mn+nk)2019.06 | 74.9 | 76.2 | 73.6 | |
| SHmax mention length (c)=n, Time Complexity=O(mn²)2019.06 | 74.5 | 76.8 | 72.3 | |
| Wang and Lu2019.08 | 74.5 | — | — | |
| Anchor-Region Networksmax mention length (c)=6, Time Complexity=O(mn+ck)2019.06 | 73.9 | 75.2 | 72.5 | |
| TransitionTime Complexity=O(mn)2019.06 | 73 | 74.5 | 71.5 | |
| SHmax mention length (c)=6, Time Complexity=O(cmn)2019.06 | 72.8 | 75.9 | 70 | |
| Cascaded-CRF2019.06 | 72.2 | 74.2 | 70.3 | |
| Ju et al.Data Split=Different Split2019.08 | 72.2 | — | — | |
| LSTM-CRFEmbeddings=Standard2019.08 | 71.62 | — | — | |
| FOFEmax mention length (c)=6, Time Complexity=O(mn²)2019.06 | 71 | 76.5 | 66.3 | |
| LHTime Complexity=O(mn)2019.06 | 70.5 | 70.6 | 70.4 | |
| Katiyar and Cardie2019.08 | 70.5 | — | — | |
| FOFEmax mention length (c)=n, Time Complexity=O(mn²)2019.06 | 68.7 | 76.9 | 62 | |
| Multi-CRFTime Complexity=O(mn)2019.06 | 65.2 | 69.7 | 61.3 | |
| Muis and LuModel Type=non-neural2019.08 | 63.1 | — | — | |
| Lu and RothModel Type=non-neural2019.08 | 62.5 | — | — | |
| LSTM-CRFTime Complexity=O(mn)2019.06 | 62.2 | 70.3 | 55.7 |