Sentiment Classification on CR (Entire dataset)
81.45AccuracyZS-SC (Top-5)*
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ZS-SC (Top-5)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-5, Base Prompt=*2023.05 | 81.45 | 79.52 | |
| ZS-SC (Top-1)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-1, Base Prompt=*2023.05 | 80.47 | 78.43 | |
| ZS-SC (Top-3)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-3, Base Prompt=*2023.05 | 79.17 | 77.84 | |
| ZS-SC (Top-5)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-5, Base Prompt=*2023.05 | 77.26 | 74.52 | |
| ZS-SC (Top-3)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-3, Base Prompt=*2023.05 | 76.82 | 74.43 | |
| UPTPrompt Generation=Automatic, Backbone=BERT base2023.05 | 75.09 | 73.53 | |
| ZS-SC (Top-1)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-1, Base Prompt=*2023.05 | 75.09 | 72.1 | |
| LM-BFFPrompt Generation=Manual, Backbone=BERT base2023.05 | 74.9 | 72.81 | |
| Base Prompt†Prompt Generation=Manual, Backbone=BERT base2023.05 | 74.9 | 72.81 | |
| ZS-SC (Top-1)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-1, Base Prompt=†2023.05 | 73.36 | 70.16 | |
| ZS-SC (Top-1)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-1, Base Prompt=†2023.05 | 73.12 | 70.65 | |
| UPTPrompt Generation=Automatic, Backbone=BERT large2023.05 | 72.62 | 71.4 | |
| LM-BFFPrompt Generation=Manual, Backbone=BERT large2023.05 | 72.59 | 70.85 | |
| Base Prompt†Prompt Generation=Manual, Backbone=BERT large2023.05 | 72.59 | 70.85 | |
| ZS-SC (Top-5)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-5, Base Prompt=†2023.05 | 71.51 | 69.32 | |
| LM-BFFPrompt Generation=Automatic, Backbone=BERT base2023.05 | 71.35 | 69.66 | |
| ZS-SC (Top-3)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-3, Base Prompt=†2023.05 | 71.19 | 68.23 | |
| LM-BFFPrompt Generation=Automatic, Backbone=BERT large2023.05 | 70.55 | 69.11 | |
| ZS-SC (Top-3)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-3, Base Prompt=†2023.05 | 70.05 | 67.82 | |
| ZS-SC (Top-5)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-5, Base Prompt=†2023.05 | 69.41 | 67.32 | |
| Base Prompt*Prompt Generation=Manual, Backbone=BERT base2023.05 | 69.04 | 64.29 | |
| PPTPrompt Generation=Manual, Backbone=BERT base2023.05 | 64.03 | 61.02 | |
| PPTPrompt Generation=Manual, Backbone=BERT large2023.05 | 63.9 | 62.21 | |
| Base Prompt*Prompt Generation=Manual, Backbone=BERT large2023.05 | 56.59 | 62.14 |