Aspect Sentiment Quad Prediction on Rest SemEval 2015 (test)
0.5221F1 ScoreMVP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MVPmulti-tasking=true2023.05 | 0.5221 | — | — | |
| MVPData=full-data2023.05 | 0.5104 | — | — | |
| MVP2023.05 | 0.5104 | — | — | |
| DLO2023.05 | 0.4818 | — | — | |
| ACOS-Contra2023.10 | 0.478 | — | — | |
| PARAPHRASEtype=Ours2021.10 | 0.4693 | 0.4616 | 0.4772 | |
| Paraphrase2023.05 | 0.4693 | — | — | |
| PARAPHRASE2023.10 | 0.468 | — | — | |
| LEGO-ABSA2023.05 | 0.461 | — | — | |
| PARAPHRASEtype=Ours, sentiment polarity semantics=false2021.10 | 0.4607 | 0.453 | 0.4687 | |
| GAStype=Unified2021.10 | 0.4598 | 0.4531 | 0.467 | |
| GAS2023.05 | 0.4598 | — | — | |
| ACOS-Base2023.10 | 0.458 | — | — | |
| PARAPHRASEtype=Ours, aspect category semantics=false2021.10 | 0.456 | 0.4465 | 0.4659 | |
| PARAPHRASEtype=Ours, polarity & category semantics=false2021.10 | 0.443 | 0.4346 | 0.4519 | |
| Extract-Classify2023.05 | 0.3642 | — | — | |
| TASO-BERT-CRFtype=Unified2021.10 | 0.3478 | 0.4424 | 0.2866 | |
| TAS-BERT2023.05 | 0.3478 | — | — | |
| ChatGPTData=few-shot2023.05 | 0.3427 | — | — | |
| TASO-BERT-Lineartype=Unified2021.10 | 0.3246 | 0.4186 | 0.265 | |
| MVP (transfer)Data=few-shot2023.05 | 0.2869 | — | — | |
| ChatGPT2023.10 | 0.262 | — | — | |
| HGCN-BERT + BERT-TFMtype=Pipeline2021.10 | 0.2365 | 0.2555 | 0.2201 | |
| ChatGPTData=zero-shot2023.05 | 0.2287 | — | — | |
| HGCN-BERT + BERT-Lineartype=Pipeline2021.10 | 0.2215 | 0.2443 | 0.2025 |