Aspect Sentiment Classification on Rest SemEval 2014 (test)
91.32AccuracyABSA-R1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ABSA-R12026.04 | 91.32 | 85.73 | |
| w/o SARAblation=without sentiment-aligned reward2026.04 | 90.5 | 84.33 | |
| CKG-BERTBackbone=BERT2026.04 | 89.24 | 83.31 | |
| w/o PRSAblation=without performance-driven rejection sampling2026.04 | 88.67 | 80.93 | |
| KaGRMN-DSGExternal Information=Aspect Knowledge, BERT, Syntax Graph, Protocol=Best Results2021.08 | 87.68 | 81.98 | |
| KGAN2026.04 | 87.15 | 82.05 | |
| InstructSFT2026.04 | 86.88 | 77.36 | |
| R-GAT+BERT*External Information=BERT, Syntax Graph, Protocol=Best Results2021.08 | 86.61 | 80.78 | |
| H-SUMepochs=42020.10 | 86.37 | 79.67 | |
| P-SUMepochs=42020.10 | 86.3 | 79.68 | |
| BERT+T-GCNExternal Information=BERT, Syntax Graph, Protocol=Best Results2021.08 | 86.16 | 79.95 | |
| BERT-PTepochs=302020.10 | 86.09 | 79.06 | |
| BAT2020.10 | 86.03 | 79.24 | |
| A-KVMN+BERTExternal Information=BERT, Syntax Graph, Protocol=Best Results2021.08 | 85.98 | 77.94 | |
| HDGCNInitialized embeddings=BERT-base2021.06 | 85.89 | 79.33 | |
| BERT-SPC*External Information=BERT, Protocol=Best Results2021.08 | 85.8 | 78.48 | |
| ASHGAT-BERTBackbone=BERT2026.04 | 85.49 | 79.23 | |
| BERT-PT*epochs=4, model_selection=proposed2020.10 | 85.43 | 77.68 | |
| KGCapsAN-BERTExternal Information=BERT, Syntax Graph, Protocol=Best Results2021.08 | 85.36 | 79 | |
| InstructABSA22026.04 | 85.17 | — | |
| SAGATExternal Information=BERT, Syntax Graph, Protocol=Best Results2021.08 | 85.08 | 77.94 | |
| BERT-PT2020.10 | 84.95 | 76.96 | |
| BERT-PTInitialized embeddings=BERT-base2021.06 | 84.95 | 76.96 | |
| SDGCN-BERTInitialized embeddings=BERT-base2021.06 | 83.57 | 76.47 | |
| MGGCN-BERTBackbone=BERT2026.04 | 83.21 | 75.38 | |
| AEN-BERTInitialized embeddings=BERT-base2021.06 | 83.12 | 73.76 | |
| MCRF-SA2020.10 | 82.86 | 73.78 | |
| CPA-SA2026.04 | 82.64 | 73.38 | |
| TNet-AS (ASVAET)Classifier=TNet-AS, Variant=ASVAET2018.10 | 81.77 | 72.57 | |
| ASCNNSource=Zhang et al. (2019)2020.10 | 81.73 | 73.1 | |
| ASCNNInitialized embeddings=GloVe2021.06 | 81.73 | 73.1 | |
| SA-LSTM-PSource=Original Paper2020.10 | 81.6 | — | |
| BERT2020.10 | 81.54 | 71.94 | |
| TNet-ATTSource=Original Paper2020.10 | 81.53 | 72.9 | |
| RMN-P2026.04 | 81.16 | 73.17 | |
| BILSTM-ATT-G (ASVAET)Classifier=BILSTM-ATT-G, Variant=ASVAET2018.10 | 81.11 | 72.19 | |
| TNet-AS (EMB)Classifier=TNet-AS, Variant=EMB2018.10 | 80.96 | 69.99 | |
| ASGCNSource=Zhang et al. (2019)2020.10 | 80.86 | 72.19 | |
| ASGCN-DTInitialized embeddings=GloVe2021.06 | 80.86 | 72.19 | |
| ASGCN-DGInitialized embeddings=GloVe2021.06 | 80.77 | 72.02 | |
| TNet-AS (ST)Classifier=TNet-AS, Variant=ST2018.10 | 80.76 | 71.32 | |
| MemNet (ASVAET)Classifier=MemNet, Variant=ASVAET2018.10 | 80.58 | 70.06 | |
| TNet-ASClassifier=TNet-AS, Variant=Standard2018.10 | 80.56 | 71.17 | |
| BILSTM-ATT-G (ST)Classifier=BILSTM-ATT-G, Variant=ST2018.10 | 80.54 | 71.88 | |
| HDGCNInitialized embeddings=GloVe2021.06 | 80.43 | 70.74 | |
| TNet-LFSource=Zhang et al. (2019)2020.10 | 80.42 | 71.03 | |
| TNet-LFInitialized embeddings=GloVe2021.06 | 80.42 | 71.03 | |
| BILSTM-ATT-G (EMB)Classifier=BILSTM-ATT-G, Variant=EMB2018.10 | 80.27 | 70.33 | |
| IAN (ASVAET)Classifier=IAN, Variant=ASVAET2018.10 | 80.23 | 70.32 | |
| IAN2026.04 | 80.18 | 69.78 | |
| SVMSource=Original Paper2020.10 | 80.16 | — | |
| AOAInitialized embeddings=GloVe2021.06 | 79.97 | 70.42 | |
| BILSTM-ATT-GClassifier=BILSTM-ATT-G, Variant=Standard2018.10 | 79.74 | 69.16 | |
| ASGCNSource=Reproduced by authors, Runs=Average of 32020.10 | 79.73 | 70.48 | |
| MemNetSource=Zhang et al. (2019)2020.10 | 79.61 | 69.64 | |
| MemNet (EMB)Classifier=MemNet, Variant=EMB2018.10 | 79.47 | 69.06 | |
| IAN (EMB)Classifier=IAN, Variant=EMB2018.10 | 79.46 | 69.45 | |
| IAN (ST)Classifier=IAN, Variant=ST2018.10 | 79.45 | 69.36 | |
| TNet-ATTSource=Reproduced by authors, Runs=Average of 32020.10 | 79.38 | 69.44 | |
| IANSource=Zhang et al. (2019)2020.10 | 79.26 | 70.09 | |
| IANClassifier=IAN, Variant=Standard2018.10 | 79.2 | 68.71 | |
| MemNet (ST)Classifier=MemNet, Variant=ST2018.10 | 78.83 | 68.92 | |
| MemNetClassifier=MemNet, Variant=Standard2018.10 | 78.68 | 68.18 | |
| PGCNN2026.04 | 78.43 | 69.58 | |
| TC-LSTM (ASVAET)Classifier=TC-LSTM, Variant=ASVAET2018.10 | 78.34 | 68.41 | |
| TC-LSTM (ST)Classifier=TC-LSTM, Variant=ST2018.10 | 78.19 | 67.65 | |
| TC-LSTMClassifier=TC-LSTM, Variant=Standard2018.10 | 77.97 | 67.55 | |
| CNN-ASPClassifier=-2018.10 | 77.82 | — | |
| GCAEClassifier=-2018.10 | 77.28 | — | |
| ATAE-LSTMSource=Original Paper2020.10 | 77.2 | — | |
| ATAE-LSTMClassifier=-2018.10 | 77.2 | — | |
| TC-LSTM (EMB)Classifier=TC-LSTM, Variant=EMB2018.10 | 77.18 | 65.97 | |
| AE-LSTMClassifier=-2018.10 | 76.6 | — |