Sentiment Classification on Poem
72.55F1 ScoreBERT-FT
Evaluation Results
| Method | Links | |
|---|---|---|
| BERT-FTBackbone=BERT-base, Evaluation Protocol=Fine-tuning2024.06 | 72.55 | |
| K-Means + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.06 | 68.7 | |
| Random + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.06 | 64.37 | |
| MMR + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.06 | 63.38 | |
| BM25 + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.06 | 61.27 | |
| SBERT + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.06 | 56.42 | |
| RandomBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.06 | 55.08 | |
| K-MeansBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.06 | 51.39 | |
| BM25Backbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.06 | 49.99 | |
| MMRBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.06 | 49.74 | |
| SBERTBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.06 | 47.41 |