# Implicit Sentiment Analysis on SemEval Laptop 2014 (test)

Source: [Implicit Sentiment Analysis on SemEval Laptop 2014 (test)](<https://www.sota2.com/research/sota/implicit-sentiment-analysis-on-semeval-laptop-2014-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-22T08:32:35.412Z

Evaluation of Implicit Sentiment Analysis performance on the test split of the SemEval 2014 Task 4 Laptop dataset, measured using F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Implicit Sentiment Analysis |
| Dataset (including any stated split) | SemEval Laptop 2014 (test) |
| Metric | F1 (All) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 (All)](<https://www.sota2.com/research/sota/implicit-sentiment-analysis-on-semeval-laptop-2014-test.md?metric=F1%20(All)>): Higher is better; unit: PERCENT.

- [F1 (ISA)](<https://www.sota2.com/research/sota/implicit-sentiment-analysis-on-semeval-laptop-2014-test.md?metric=F1%20(ISA)>): Higher is better; unit: PERCENT.

- [Macro-F1](<https://www.sota2.com/research/sota/implicit-sentiment-analysis-on-semeval-laptop-2014-test.md?metric=Macro-F1>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 (All) | Result date | Report paper |
| --- | --- | --- | --- |
| GPT3+THOR | 76.04 | Not recorded | 68fa6fbc1e209131cea471d1 |
| Flan-T5+THOR | 58.27 | Not recorded | 68fa6fbc1e209131cea471d1 |
| Flan-T5+THOR | 56.36 | Not recorded | 68fa6fbc1e209131cea471d1 |
| Flan-T5+ZeroCoT | 55.53 | Not recorded | 68fa6fbc1e209131cea471d1 |
| Flan-T5+Prompt | 54.14 | Not recorded | 68fa6fbc1e209131cea471d1 |
| Flan-T5+THOR | 52.52 | Not recorded | 68fa6fbc1e209131cea471d1 |
| Flan-T5+Prompt | 52.06 | Not recorded | 68fa6fbc1e209131cea471d1 |
| BERT+Prompt | 35.17 | Not recorded | 68fa6fbc1e209131cea471d1 |
| BERTAsp+SCAPT | 25.77 | Not recorded | 68fa6fbc1e209131cea471d1 |
| BERT+RGAT | 25.68 | Not recorded | 68fa6fbc1e209131cea471d1 |
| BERT+SPC | 25.34 | Not recorded | 68fa6fbc1e209131cea471d1 |

### GPT3+THOR

F1 (All): 76.04. Result ID: 6990e8fa3a6c314849043793.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Implementation](<https://github.com/scofield7419/THOR-ISA>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"175B","Backbone":"GPT3","Prompting Strategy":"THOR (CoT)"}. This record does not assert independent reproduction.

### Flan-T5+THOR

F1 (All): 58.27. Result ID: 6990e8fa3a6c314849043791.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Implementation](<https://github.com/scofield7419/THOR-ISA>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"11B","Backbone":"Flan-T5","Prompting Strategy":"THOR (CoT)"}. This record does not assert independent reproduction.

### Flan-T5+THOR

F1 (All): 56.36. Result ID: 6990e8fa3a6c314849043790.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Implementation](<https://github.com/scofield7419/THOR-ISA>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"3B","Backbone":"Flan-T5","Prompting Strategy":"THOR (CoT)"}. This record does not assert independent reproduction.

### Flan-T5+ZeroCoT

F1 (All): 55.53. Result ID: 6990e8fa3a6c314849043792.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa680c1e209131cea19d53.md>)

[Implementation](<https://github.com/openai/gpt-3/blob/master/overlap_frequency.md>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"11B","Backbone":"Flan-T5","Prompting Strategy":"Zero-shot CoT"}. This record does not assert independent reproduction.

### Flan-T5+Prompt

F1 (All): 54.14. Result ID: 6990e8fa3a6c31484904378e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"11B","Backbone":"Flan-T5","Prompting Strategy":"Vanilla"}. This record does not assert independent reproduction.

### Flan-T5+THOR

F1 (All): 52.52. Result ID: 6990e8fa3a6c31484904378f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Implementation](<https://github.com/scofield7419/THOR-ISA>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"250M","Backbone":"Flan-T5","Prompting Strategy":"THOR (CoT)"}. This record does not assert independent reproduction.

### Flan-T5+Prompt

F1 (All): 52.06. Result ID: 6990e8fa3a6c31484904378d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"250M","Backbone":"Flan-T5","Prompting Strategy":"Vanilla"}. This record does not assert independent reproduction.

### BERT+Prompt

F1 (All): 35.17. Result ID: 6990e8fa3a6c31484904378c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"110M","Backbone":"BERT","Prompting Strategy":"Vanilla"}. This record does not assert independent reproduction.

### BERTAsp+SCAPT

F1 (All): 25.77. Result ID: 6990e8fa3a6c31484904378b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b291e209131cea2c6f1.md>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"110M","Backbone":"BERT"}. This record does not assert independent reproduction.

### BERT+RGAT

F1 (All): 25.68. Result ID: 6990e8fa3a6c31484904378a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676c1e209131cea160cd.md>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"110M","Backbone":"BERT"}. This record does not assert independent reproduction.

### BERT+SPC

F1 (All): 25.34. Result ID: 6990e8fa3a6c314849043789.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea471d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Setting":"Zero-shot","Number of Parameters":"110M","Backbone":"BERT"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
