Implicit Sentiment Analysis on SemEval Restaurant ISA 2014
79.73F1THOR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| THORModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.05 | 79.73 | — | — | |
| THORModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning, Method Variation=w/o Reason-revising2023.05 | 78.42 | — | — | |
| THORModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning, Method Variation=w/o Self-consistency2023.05 | 77.68 | — | — | |
| Flan-T5+PromptModel Parameters=11B, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.05 | 75.1 | — | — | |
| BERTAsp+SCAPTModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.05 | 72.28 | — | — | |
| THORModel Parameters=250M, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.05 | 71.7 | — | — | |
| Flan-T5+PromptModel Parameters=250M, Backbone=Flan-T5, Evaluation Protocol=Supervised fine-tuning2023.05 | 70.91 | — | — | |
| BERT+PromptModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.05 | 70.12 | — | — | |
| BERT+ISAIVModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.05 | 69.66 | — | — | |
| BERT+RGATModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.05 | 67.79 | — | — | |
| BERTAsp+CEPTModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.05 | 67.79 | — | — | |
| BERT+ADAModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.05 | 65.92 | — | — | |
| BERT+SPCModel Parameters=110M, Backbone=BERT, Evaluation Protocol=Supervised fine-tuning2023.05 | 65.54 | — | — | |
| BERT+PromptSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT, Prompting Strategy=Vanilla2023.05 | — | 33.62 | 31.46 | |
| BERT+RGATSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT2023.05 | — | 27.48 | 22.04 | |
| BERT+SPCSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT2023.05 | — | 21.76 | 19.48 | |
| BERTAsp+SCAPTSetting=Zero-shot, Number of Parameters=110M, Backbone=BERT2023.05 | — | 30.02 | 25.49 | |
| Flan-T5+PromptSetting=Zero-shot, Number of Parameters=250M, Backbone=Flan-T5, Prompting Strategy=Vanilla2023.05 | — | 54.38 | 41.57 | |
| Flan-T5+PromptSetting=Zero-shot, Number of Parameters=11B, Backbone=Flan-T5, Prompting Strategy=Vanilla2023.05 | — | 57.12 | 45.31 | |
| Flan-T5+THORSetting=Zero-shot, Number of Parameters=250M, Backbone=Flan-T5, Prompting Strategy=THOR (CoT)2023.05 | — | 55.86 | 41.84 | |
| Flan-T5+THORSetting=Zero-shot, Number of Parameters=3B, Backbone=Flan-T5, Prompting Strategy=THOR (CoT)2023.05 | — | 57.33 | 42.61 | |
| Flan-T5+THORSetting=Zero-shot, Number of Parameters=11B, Backbone=Flan-T5, Prompting Strategy=THOR (CoT)2023.05 | — | 61.87 | 52.76 | |
| Flan-T5+ZeroCoTSetting=Zero-shot, Number of Parameters=11B, Backbone=Flan-T5, Prompting Strategy=Zero-shot CoT2023.05 | — | 56.58 | 47.41 | |
| GPT3+THORSetting=Zero-shot, Number of Parameters=175B, Backbone=GPT3, Prompting Strategy=THOR (CoT)2023.05 | — | 81.96 | 76.55 |