Sentiment Classification on MR (Accuracy and F1)
72.96AccuracyZS-SC (Top-3)*
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ZS-SC (Top-3)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-3, Base Prompt=*2023.05 | 72.96 | 73.54 | |
| ZS-SC (Top-5)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-5, Base Prompt=*2023.05 | 72.46 | 73.43 | |
| ZS-SC (Top-1)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-1, Base Prompt=*2023.05 | 70.29 | 70.36 | |
| ZS-SC (Top-1)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-1, Base Prompt=†2023.05 | 69.84 | 71.75 | |
| ZS-SC (Top-1)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-1, Base Prompt=*2023.05 | 68.24 | 68.26 | |
| ZS-SC (Top-3)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-3, Base Prompt=*2023.05 | 67.88 | 67.89 | |
| ZS-SC (Top-5)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-5, Base Prompt=*2023.05 | 66.74 | 66.88 | |
| UPTPrompt Generation=Automatic, Backbone=BERT large2023.05 | 65.2 | 69.69 | |
| ZS-SC (Top-3)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-3, Base Prompt=†2023.05 | 64.15 | 67.91 | |
| ZS-SC (Top-5)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-5, Base Prompt=†2023.05 | 63.47 | 67.76 | |
| UPTPrompt Generation=Automatic, Backbone=BERT base2023.05 | 62.65 | 66.78 | |
| ZS-SC (Top-5)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-5, Base Prompt=†2023.05 | 61.19 | 62.92 | |
| ZS-SC (Top-3)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-3, Base Prompt=†2023.05 | 60.15 | 60.14 | |
| Base Prompt*Prompt Generation=Manual, Backbone=BERT base2023.05 | 59.97 | 60.25 | |
| ZS-SC (Top-1)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-1, Base Prompt=†2023.05 | 58.93 | 62.07 | |
| LM-BFFPrompt Generation=Manual, Backbone=BERT base2023.05 | 58.18 | 62.16 | |
| Base Prompt†Prompt Generation=Manual, Backbone=BERT base2023.05 | 58.18 | 62.16 | |
| LM-BFFPrompt Generation=Automatic, Backbone=BERT base2023.05 | 57.94 | 62.81 | |
| LM-BFFPrompt Generation=Manual, Backbone=BERT large2023.05 | 57.88 | 62.64 | |
| Base Prompt†Prompt Generation=Manual, Backbone=BERT large2023.05 | 57.88 | 62.64 | |
| LM-BFFPrompt Generation=Automatic, Backbone=BERT large2023.05 | 57.3 | 63.69 | |
| Base Prompt*Prompt Generation=Manual, Backbone=BERT large2023.05 | 54.43 | 57.12 | |
| PPTPrompt Generation=Manual, Backbone=BERT base2023.05 | 50.5 | 53.41 | |
| PPTPrompt Generation=Manual, Backbone=BERT large2023.05 | 50.5 | 56 |