Sentiment and topic classification on Subj
74.1Macro F1BC
Evaluation results
| Method | Links | |
|---|---|---|
| BCModel=Qwen, Shots=42025.05 | 74.1 | |
| GPT-J (DC)Backbone=GPT-J, Prompting=DC, Shots=8-shot2023.05 | 70.7 | |
| GPT-J (Original)Backbone=GPT-J, Prompting=Original, Shots=8-shot2023.05 | 65.2 | |
| SCModel=Qwen, Shots=42025.05 | 62.23 | |
| GPT-J (CC)Backbone=GPT-J, Prompting=CC, Shots=8-shot2023.05 | 61.9 | |
| SCModel=Mistral, Shots=42025.05 | 59.38 | |
| SCModel=Llama, Shots=42025.05 | 55.79 | |
| BCModel=Llama, Shots=42025.05 | 54.15 | |
| BCModel=Mistral, Shots=42025.05 | 48.05 | |
| Base LLMModel=Llama, Shots=42025.05 | 40.18 | |
| CCModel=Qwen, Shots=42025.05 | 38.54 | |
| DCModel=Qwen, Shots=42025.05 | 36.97 | |
| Base LLMModel=Mistral, Shots=42025.05 | 35.03 | |
| Base LLMModel=Qwen, Shots=42025.05 | 33.02 | |
| CCModel=Llama, Shots=42025.05 | 32.36 | |
| DCModel=Llama, Shots=42025.05 | 32.36 | |
| CCModel=Mistral, Shots=42025.05 | 31.55 | |
| DCModel=Mistral, Shots=42025.05 | 31.55 |