Sentiment Classification on SST (test)
93.8Accuracy8k mLSTM
Evaluation Results
| Method | Links | |
|---|---|---|
| 8k mLSTM2018.12 | 93.8 | |
| SENTECONInterpretable?=Yes, M_theta=Fine-tuned, Base Lexicon=LIWC (L)2023.05 | 93.4 | |
| MPNetInterpretable?=No, M_theta=Fine-tuned2023.05 | 93.4 | |
| SENTECON+Interpretable?=Yes, M_theta=Fine-tuned, Base Lexicon=Empath (E)2023.05 | 93.3 | |
| SENTECON+Interpretable?=Yes, M_theta=Fine-tuned, Base Lexicon=LIWC (L)2023.05 | 93.2 | |
| SENTECONInterpretable?=Yes, M_theta=Fine-tuned, Base Lexicon=Empath (E)2023.05 | 93.2 | |
| mLSTM (Gray et al.)2018.12 | 93.1 | |
| ELMO+BiLSTM+Attn2018.12 | 91.6 | |
| Transformertraining_mode=finetune2018.12 | 90.9 | |
| mLSTMtraining_mode=finetune2018.12 | 90.4 | |
| Pre-trained MPNetInterpretable=No, M_theta=None2023.05 | 89.5 | |
| SENTECON+Base Lexicon=Empath, Interpretable=Yes, M_theta=Pre-trained2023.05 | 88.9 | |
| SENTECONBase Lexicon=Empath, Interpretable=Yes, M_theta=Pre-trained2023.05 | 88.7 | |
| SENTECON+Base Lexicon=LIWC, Interpretable=Yes, M_theta=Pre-trained2023.05 | 88 | |
| SENTECONBase Lexicon=LIWC, Interpretable=Yes, M_theta=Pre-trained2023.05 | 86.5 | |
| Watson APImode=thresholded2018.12 | 84.4 | |
| Empath+word2vecBase Lexicon=Empath, Interpretable=Yes, M_theta=None2023.05 | 81.4 | |
| Google Sentiment (GCL) APImode=thresholded2018.12 | 81.3 | |
| ELMOtraining_mode=finetune2018.12 | 79.9 | |
| LIWC+word2vecBase Lexicon=LIWC, Interpretable=Yes, M_theta=None2023.05 | 78.7 | |
| LexiconBase Lexicon=LIWC, Interpretable=Yes, M_theta=None2023.05 | 67.8 | |
| LexiconBase Lexicon=Empath, Interpretable=Yes, M_theta=None2023.05 | 63.4 | |
| MEANmodel=full model2018.07 | 51.4 | |
| NSCL2018.07 | 51.1 | |
| Tree-LSTM2018.07 | 51 | |
| LR-Bi-LSTM2018.07 | 50.6 | |
| ID-LSTM2018.07 | 50 | |
| MEAN w/o CharCNNcharacter-level embedding=excluded2018.07 | 50 | |
| Majority / meanInterpretable=No, M_theta=None2023.05 | 49.9 | |
| MEAN w/o negation wordsnegation words=excluded2018.07 | 49.5 | |
| MEAN w/o intensity wordsintensity words=excluded2018.07 | 49.3 | |
| BiLSTM2018.07 | 49.1 | |
| Self-attentionimplementation=re-implemented by current paper2018.07 | 48.9 | |
| MEAN w/o sentiment wordssentiment words=excluded2018.07 | 48.4 | |
| CNN2018.07 | 48 | |
| LSTM2018.07 | 46.4 | |
| RNTN2018.07 | 45.7 |