Aspect Polarity Classification on Twitter
75.16F1 Score (APC)BERT-SPC
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BERT-SPCinput_format=SPC2019.12 | 75.16 | 76.27 | |
| LCF-ATEPC-CDWmechanism=CDW2019.12 | 75.04 | 76.56 | |
| BERT-BASE2019.12 | 74.91 | 76.27 | |
| LCF-ATEPC-Fusionmechanism=Fusion2019.12 | 74.54 | 76.7 | |
| LCF-ATEPC-CDMmechanism=CDM2019.12 | 74.06 | 75.11 | |
| AEN-BERT2019.12 | 73.13 | 74.71 | |
| K-Means + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.06 | 57.78 | — | |
| Random + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.06 | 57.64 | — | |
| BERT-FTBackbone=BERT-base, Evaluation Protocol=Fine-tuning2024.06 | 56.4 | — | |
| BM25 + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.06 | 56.22 | — | |
| SBERT + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.06 | 56.07 | — | |
| MMR + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.06 | 55.57 | — | |
| K-MeansBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.06 | 55.2 | — | |
| RandomBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.06 | 54.95 | — | |
| MMRBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.06 | 51.07 | — | |
| BM25Backbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.06 | 50.99 | — | |
| SBERTBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.06 | 50.6 | — |