List your company
ResearchFormerly WizWand

Nested Mention Detection on ACE2005 (test)

84.33F1 Scoreseq2seq+BERT+Flair
61.314867.289973.26579.2401Jun 10, 2019Jun 21, 2019Jul 3, 2019Jul 15, 2019Jul 26, 2019Aug 7, 2019Aug 19, 2019
Updated 8mo ago

Evaluation results

MethodLinks
seq2seq+BERT+FlairEmbeddings=BERT+Flair2019.0884.33——
seq2seq+BERTEmbeddings=BERT2019.0883.42——
seq2seq+ELMo+BERT+FlairEmbeddings=ELMo+BERT+Flair2019.0883.41——
seq2seq+BERT+ELMoEmbeddings=BERT+ELMo2019.0882.15——
seq2seq+ELMoEmbeddings=ELMo2019.0881.95——
LSTM-CRF+BERT+FlairEmbeddings=BERT+Flair2019.0880.82——
LSTM-CRF+BERT+ELMoEmbeddings=BERT+ELMo2019.0880.04——
LSTM-CRF+BERTEmbeddings=BERT2019.0879.95——
LSTM-CRF+ELMo+BERT+FlairEmbeddings=ELMo+BERT+Flair2019.0879.85——
seq2seq+FlairEmbeddings=Flair2019.0879.83——
LSTM-CRF+ELMoEmbeddings=ELMo2019.0878.36——
LSTM-CRF+FlairEmbeddings=Flair2019.0877.25——
seq2seqEmbeddings=Standard2019.0875.36——
Anchor-Region Networksmax mention length (c)=n, Time Complexity=O(mn+nk)2019.0674.976.273.6
SHmax mention length (c)=n, Time Complexity=O(mn²)2019.0674.576.872.3
Wang and Lu2019.0874.5——
Anchor-Region Networksmax mention length (c)=6, Time Complexity=O(mn+ck)2019.0673.975.272.5
TransitionTime Complexity=O(mn)2019.067374.571.5
SHmax mention length (c)=6, Time Complexity=O(cmn)2019.0672.875.970
Cascaded-CRF2019.0672.274.270.3
Ju et al.Data Split=Different Split2019.0872.2——
LSTM-CRFEmbeddings=Standard2019.0871.62——
FOFEmax mention length (c)=6, Time Complexity=O(mn²)2019.067176.566.3
LHTime Complexity=O(mn)2019.0670.570.670.4
Katiyar and Cardie2019.0870.5——
FOFEmax mention length (c)=n, Time Complexity=O(mn²)2019.0668.776.962
Multi-CRFTime Complexity=O(mn)2019.0665.269.761.3
Muis and LuModel Type=non-neural2019.0863.1——
Lu and RothModel Type=non-neural2019.0862.5——
LSTM-CRFTime Complexity=O(mn)2019.0662.270.355.7