List your company
ResearchFormerly WizWand

Sentiment Classification on MR (Accuracy and F1)

72.96AccuracyZS-SC (Top-3)*
49.601655.665861.7367.7942May 25, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ZS-SC (Top-3)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-3, Base Prompt=*2023.0572.9673.54
ZS-SC (Top-5)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-5, Base Prompt=*2023.0572.4673.43
ZS-SC (Top-1)*Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-1, Base Prompt=*2023.0570.2970.36
ZS-SC (Top-1)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-1, Base Prompt=†2023.0569.8471.75
ZS-SC (Top-1)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-1, Base Prompt=*2023.0568.2468.26
ZS-SC (Top-3)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-3, Base Prompt=*2023.0567.8867.89
ZS-SC (Top-5)*Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-5, Base Prompt=*2023.0566.7466.88
UPTPrompt Generation=Automatic, Backbone=BERT large2023.0565.269.69
ZS-SC (Top-3)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-3, Base Prompt=†2023.0564.1567.91
ZS-SC (Top-5)†Prompt Generation=Automatic, Backbone=BERT large, Aggregation=Top-5, Base Prompt=†2023.0563.4767.76
UPTPrompt Generation=Automatic, Backbone=BERT base2023.0562.6566.78
ZS-SC (Top-5)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-5, Base Prompt=†2023.0561.1962.92
ZS-SC (Top-3)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-3, Base Prompt=†2023.0560.1560.14
Base Prompt*Prompt Generation=Manual, Backbone=BERT base2023.0559.9760.25
ZS-SC (Top-1)†Prompt Generation=Automatic, Backbone=BERT base, Aggregation=Top-1, Base Prompt=†2023.0558.9362.07
LM-BFFPrompt Generation=Manual, Backbone=BERT base2023.0558.1862.16
Base Prompt†Prompt Generation=Manual, Backbone=BERT base2023.0558.1862.16
LM-BFFPrompt Generation=Automatic, Backbone=BERT base2023.0557.9462.81
LM-BFFPrompt Generation=Manual, Backbone=BERT large2023.0557.8862.64
Base Prompt†Prompt Generation=Manual, Backbone=BERT large2023.0557.8862.64
LM-BFFPrompt Generation=Automatic, Backbone=BERT large2023.0557.363.69
Base Prompt*Prompt Generation=Manual, Backbone=BERT large2023.0554.4357.12
PPTPrompt Generation=Manual, Backbone=BERT base2023.0550.553.41
PPTPrompt Generation=Manual, Backbone=BERT large2023.0550.556