List your company

Aspect Sentiment Classification on Rest

71.76F1 ScoreBM25 + Feedback-ICL
64.303266.239168.17570.1109Jun 5, 2024

Evaluation results

MethodLinks
BM25 + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.0671.76
SBERT + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.0671.29
Random + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.0671.16
K-Means + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.0671.1
K-MeansBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.0671.01
MMR + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.0669.76
BM25Backbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.0668.99
RandomBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.0668.77
MMRBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.0668.3
SBERTBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.0668.21
BERT-FTBackbone=BERT-base, Evaluation Protocol=Fine-tuning2024.0664.59