Aspect term-polarity pair extraction on SemEval Laptop (SL) (test)
0.7071F1 ScoreGRACE
Evaluation Results
| Method | Links | |
|---|---|---|
| GRACE2020.09 | 0.7071 | |
| GRACEVAT=false2020.09 | 0.6989 | |
| GRACEGHL=false2020.09 | 0.6724 | |
| GRACEPTR=false2020.09 | 0.6396 | |
| RACL-BERT2020.09 | 0.634 | |
| DREGCN2020.09 | 0.6304 | |
| WHW2020.09 | 0.6234 | |
| IKTN-BERT2020.09 | 0.6234 | |
| DOERApproach category=Joint (Ours), Architecture=Dual crOss-sharEd RNN, Components=CSU + AuL + AuS2019.06 | 0.6035 | |
| S-BiReGU+CSU+AuSApproach category=Joint (Ours), Architecture=Stacked ReGU, Component=CSU, Auxiliary task=Sentiment lexicon enhancement (AuS)2019.06 | 0.6011 | |
| DHGNN2020.09 | 0.5961 | |
| S-BiReGU+CSU+AuLApproach category=Joint (Ours), Architecture=Stacked ReGU, Component=CSU, Auxiliary task=Aspect term length enhancement (AuL)2019.06 | 0.5906 | |
| S-BiReGU+CSUApproach category=Joint (Ours), Architecture=Stacked ReGU, Component=Compositional Sentiment Unit (CSU)2019.06 | 0.5899 | |
| IMN2020.09 | 0.5837 | |
| E2E-TBSAApproach category=Collapsed Baselines, Architecture=End-to-end collapsed approach2019.06 | 0.5799 | |
| S-BiReGUApproach category=Joint (Ours), Architecture=Stacked ReGU2019.06 | 0.5782 | |
| S-BILSTMApproach category=Joint (Ours), Architecture=Stacked BiLSTM2019.06 | 0.5683 | |
| DE-CNN+TNetApproach category=Pipeline Baselines, Architecture=DE-CNN+TNet2019.06 | 0.5647 | |
| LM-LSTM-CRFApproach category=Collapsed Baselines, Architecture=Language Model enhanced LSTM-CRF2019.06 | 0.5639 | |
| LSTM+CRF-CNNcApproach category=Collapsed Baselines, Architecture=BiLSTM+CRF, Embedding=Char embedding by CNN2019.06 | 0.5471 | |
| LSTM+CRF-LSTMcApproach category=Collapsed Baselines, Architecture=BiLSTM+CRF, Embedding=Char embedding by BiLSTM2019.06 | 0.5443 | |
| NN+CRF-pipelineApproach category=Pipeline Baselines, Architecture=NN+CRF2019.06 | 0.5336 | |
| NN+CRF-jointApproach category=Joint Baselines, Architecture=NN+CRF2019.06 | 0.5281 | |
| CRF-pipelineApproach category=Pipeline Baselines, Architecture=CRF2019.06 | 0.5108 | |
| CRF-jointApproach category=Joint Baselines, Architecture=CRF2019.06 | 0.5073 | |
| NN+CRF-collapsedApproach category=Collapsed Baselines, Architecture=NN+CRF2019.06 | 0.5064 | |
| Sentiment-ScopeApproach category=Collapsed Baselines, Architecture=Sentiment-Scope2019.06 | 0.5027 | |
| CRF-collapsedApproach category=Collapsed Baselines, Architecture=CRF2019.06 | 0.4924 |