Emotion Detection on TwEmo
62.88F1 ScoreBM25 + Feedback-ICL
Evaluation results
| Method | Links | |
|---|---|---|
| BM25 + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.06 | 62.88 | |
| BERT-FTBackbone=BERT-base, Evaluation Protocol=Fine-tuning2024.06 | 62.53 | |
| K-Means + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.06 | 61.89 | |
| MMR + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.06 | 61.74 | |
| SBERT + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.06 | 61.22 | |
| Random + Feedback-ICLBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.06 | 60.91 | |
| MMRBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=MMR2024.06 | 49.94 | |
| SBERTBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=SBERT2024.06 | 48.58 | |
| BM25Backbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=BM252024.06 | 48.44 | |
| RandomBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=Random2024.06 | 47.77 | |
| K-MeansBackbone=Llama-2 13B Chat, Evaluation Protocol=In-context learning, Number of in-context examples=4, Retrieval Strategy=K-Means2024.06 | 46.93 |