List your company
ResearchFormerly WizWand

Implicit Sentiment Analysis on SemEval Restaurant ISA 2014

79.73F1THOR
64.972468.803772.63576.4663May 18, 2023
Updated 8mo ago

Evaluation results

MethodLinks
THORModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.0579.73——
THORModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning, Method Variation=w/o Reason-revising2023.0578.42——
THORModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning, Method Variation=w/o Self-consistency2023.0577.68——
Flan-T5+PromptModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.0575.1——
BERTAsp+SCAPTModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.0572.28——
THORModel Parameters=250M, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.0571.7——
Flan-T5+PromptModel Parameters=250M, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.0570.91——
BERT+PromptModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.0570.12——
BERT+ISAIVModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.0569.66——
BERT+RGATModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.0567.79——
BERTAsp+CEPTModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.0567.79——
BERT+ADAModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.0565.92——
BERT+SPCModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.0565.54——
BERT+PromptSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT, Prompting Strategy=Vanilla2023.05—33.6231.46
BERT+RGATSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT2023.05—27.4822.04
BERT+SPCSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT2023.05—21.7619.48
BERTAsp+SCAPTSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT2023.05—30.0225.49
Flan-T5+PromptSetting=Zero-shot, Number of Parameters=250M, Backbone=Flan-T5, Prompting Strategy=Vanilla2023.05—54.3841.57
Flan-T5+PromptSetting=Zero-shot, Number of Parameters=11B, Backbone=Flan-T5, Prompting Strategy=Vanilla2023.05—57.1245.31
Flan-T5+THORSetting=Zero-shot, Number of Parameters=250M, Backbone=Flan-T5, Prompting Strategy=THOR (CoT)2023.05—55.8641.84
Flan-T5+THORSetting=Zero-shot, Number of Parameters=3B, Backbone=Flan-T5, Prompting Strategy=THOR (CoT)2023.05—57.3342.61
Flan-T5+THORSetting=Zero-shot, Number of Parameters=11B, Backbone=Flan-T5, Prompting Strategy=THOR (CoT)2023.05—61.8752.76
Flan-T5+ZeroCoTSetting=Zero-shot, Number of Parameters=11B, Backbone=Flan-T5, Prompting Strategy=Zero-shot CoT2023.05—56.5847.41
GPT3+THORSetting=Zero-shot, Number of Parameters=175B, Backbone=GPT3, Prompting Strategy=THOR (CoT)2023.05—81.9676.55