# Aspect-based Sentiment Analysis on SemEval Restaurant 2014 (All) Source: [Aspect-based Sentiment Analysis on SemEval Restaurant 2014 (All)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:43:19.932Z Evaluation of Aspect-based Sentiment Analysis performance on the complete (all splits) SemEval 2014 Task 4 dataset focusing on the Restaurant domain. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Aspect-based Sentiment Analysis | | Dataset (including any stated split) | SemEval Restaurant 2014 (All) | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 19 of 19 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | THOR | 87.45 | Not recorded | 68fa6fbc1e209131cea471d1 | | THOR | 86.88 | Not recorded | 68fa6fbc1e209131cea471d1 | | THOR | 86.03 | Not recorded | 68fa6fbc1e209131cea471d1 | | Flan-T5+Prompt | 84.72 | Not recorded | 68fa6fbc1e209131cea471d1 | | BERTAsp+SCAPT | 83.79 | Not recorded | 68fa6fbc1e209131cea471d1 | | THOR | 82.98 | Not recorded | 68fa6fbc1e209131cea471d1 | | BERTAsp+CEPT | 82.07 | Not recorded | 68fa6fbc1e209131cea471d1 | | Flan-T5+Prompt | 81.5 | Not recorded | 68fa6fbc1e209131cea471d1 | | BERT+ISAIV | 81.4 | Not recorded | 68fa6fbc1e209131cea471d1 | | BERT+RGAT | 81.35 | Not recorded | 68fa6fbc1e209131cea471d1 | | BERT+Prompt | 81.34 | Not recorded | 68fa6fbc1e209131cea471d1 | | BERT+ADA | 80.05 | Not recorded | 68fa6fbc1e209131cea471d1 | | BERT+SPC | 77.16 | Not recorded | 68fa6fbc1e209131cea471d1 | | Extra | 60.09 | Not recorded | 68fa73401e209131cea5b47a | | CoTAM | 56.36 | Not recorded | 68fa73401e209131cea5b47a | | FlipDA++ | 51.38 | Not recorded | 68fa73401e209131cea5b47a | | LLM SL | 49.54 | Not recorded | 68fa73401e209131cea5b47a | | CoTDA | 47.57 | Not recorded | 68fa73401e209131cea5b47a | | Base | 34.82 | Not recorded | 68fa73401e209131cea5b47a | ### THOR F1 Score: 87.45. Result ID: 6990e8fa3a6c314849043754. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Parameters":"11B","Backbone":"Flan-T5","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### THOR F1 Score: 86.88. Result ID: 6990e8fa3a6c314849043756. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Parameters":"11B","Backbone":"Flan-T5","Evaluation Protocol":"Supervised fine-tuning","Method Variation":"w/o Reason-revising"}. This record does not assert independent reproduction. ### THOR F1 Score: 86.03. Result ID: 6990e8fa3a6c314849043755. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Parameters":"11B","Backbone":"Flan-T5","Evaluation Protocol":"Supervised fine-tuning","Method Variation":"w/o Self-consistency"}. This record does not assert independent reproduction. ### Flan-T5+Prompt F1 Score: 84.72. Result ID: 6990e8fa3a6c314849043752. [Reporting paper]() Recorded evaluation configuration: {"Model Parameters":"11B","Backbone":"Flan-T5","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### BERTAsp+SCAPT F1 Score: 83.79. Result ID: 6990e8fa3a6c31484904374f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Parameters":"110M","Backbone":"BERT","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### THOR F1 Score: 82.98. Result ID: 6990e8fa3a6c314849043753. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Parameters":"250M","Backbone":"Flan-T5","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### BERTAsp+CEPT F1 Score: 82.07. Result ID: 6990e8fa3a6c31484904374d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Parameters":"110M","Backbone":"BERT","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### Flan-T5+Prompt F1 Score: 81.5. Result ID: 6990e8fa3a6c314849043751. [Reporting paper]() Recorded evaluation configuration: {"Model Parameters":"250M","Backbone":"Flan-T5","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### BERT+ISAIV F1 Score: 81.4. Result ID: 6990e8fa3a6c31484904374e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Parameters":"110M","Backbone":"BERT","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### BERT+RGAT F1 Score: 81.35. Result ID: 6990e8fa3a6c31484904374c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Parameters":"110M","Backbone":"BERT","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### BERT+Prompt F1 Score: 81.34. Result ID: 6990e8fa3a6c314849043750. [Reporting paper]() Recorded evaluation configuration: {"Model Parameters":"110M","Backbone":"BERT","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### BERT+ADA F1 Score: 80.05. Result ID: 6990e8fa3a6c31484904374b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Parameters":"110M","Backbone":"BERT","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### BERT+SPC F1 Score: 77.16. Result ID: 6990e8fa3a6c31484904374a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Parameters":"110M","Backbone":"BERT","Evaluation Protocol":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### Extra F1 Score: 60.09. Result ID: 6992b2083a6c31484910cb07. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CoTAM F1 Score: 56.36. Result ID: 6992b2083a6c31484910cb0b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"shot\_number (K)":10,"generation\_count (N)":3,"backbone":"RoBERTa-Large","embedding\_model":"SimCSE"}. This record does not assert independent reproduction. ### FlipDA++ F1 Score: 51.38. Result ID: 6992b2083a6c31484910cb09. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLM SL F1 Score: 49.54. Result ID: 6992b2083a6c31484910cb08. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CoTDA F1 Score: 47.57. Result ID: 6992b2083a6c31484910cb0a. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Base F1 Score: 34.82. Result ID: 6992b2083a6c31484910cb06. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.