Sentiment and topic classification on Subj (test)
89.3Macro-F1IDAICL
Evaluation results
| Method | Links | |
|---|---|---|
| IDAICLPLM=LLaMA 33B, m=42024.06 | 89.3 | |
| PROCAPLM=LLaMA 33B, m=42024.06 | 88.3 | |
| IDAICLPLM=LLaMA 13B, m=42024.06 | 87.8 | |
| Vanilla ICLPLM=LLaMA 33B, m=42024.06 | 85.1 | |
| PROCAPLM=LLaMA 13B, m=42024.06 | 84.8 | |
| D-ConCaPLM=LLaMA 13B, m=42024.06 | 82.9 | |
| ConCaPLM=LLaMA 13B, m=42024.06 | 79.6 | |
| D-ConCaPLM=LLaMA 33B, m=42024.06 | 76.4 | |
| ConCaPLM=LLaMA 33B, m=42024.06 | 74.6 | |
| Vanilla ICLPLM=LLaMA 13B, m=42024.06 | 72.9 | |
| RoBERTa-large (Context Calibration)Model=RoBERTa-large, Setting=CC, Evaluation protocol=Zero-shot prompting2023.05 | 51.6 | |
| RoBERTa-large (Domain-context Calibration)Model=RoBERTa-large, Setting=DC, Evaluation protocol=Zero-shot prompting2023.05 | 44.3 | |
| RoBERTa-large (Original)Model=RoBERTa-large, Setting=Original, Evaluation protocol=Zero-shot prompting2023.05 | 37.9 |