# Aspect Sentiment Classification on Restaurant SemEval 2015 (test) Source: [Aspect Sentiment Classification on Restaurant SemEval 2015 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-27T09:17:13.871Z Evaluation of Aspect Sentiment Classification performance on the test set of the SemEval 2015 Restaurant domain dataset, measured by Accuracy and F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Aspect Sentiment Classification | | Dataset (including any stated split) | Restaurant SemEval 2015 (test) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 38 of 38 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. - [Macro F1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | IT-RER-ABSA | 94.31 | Not recorded | 68fa73691e209131cea5c4fe | | LSAE-X-DeBERTa | 91.85 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAT-X-DeBERTa | 91.09 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAS-X-DeBERTa | 90.63 | Not recorded | 68fa72b01e209131cea57eb2 | | COLA | 90.5 | Not recorded | 68fa72f11e209131cea59707 | | LSAP-X-DeBERTa | 89.98 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAT-DeBERTa | 89.61 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAE-DeBERTa | 89.47 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAS-DeBERTa | 89.42 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAP-DeBERTa | 89.05 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAE-RoBERTa | 88.39 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAS-RoBERTa | 88.31 | Not recorded | 68fa72b01e209131cea57eb2 | | SARL-RoBERTa | 88.19 | Not recorded | 68fa72b01e209131cea57eb2 | | DeBERTa | 87.5 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAP-RoBERTa | 87.01 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAT-RoBERTa | 86.64 | Not recorded | 68fa72b01e209131cea57eb2 | | SARL-DeBERTa | 86.53 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAE-BERT | 85.56 | Not recorded | 68fa72b01e209131cea57eb2 | | dotGCN | 85.2 | Not recorded | 68fa72f11e209131cea59707 | | LSAT-BERT | 84.93 | Not recorded | 68fa72b01e209131cea57eb2 | | InstructABSA2 | 84.5 | Not recorded | 68fa73691e209131cea5c4fe | | LSAS-BERT | 84.22 | Not recorded | 68fa72b01e209131cea57eb2 | | LSAP-BERT | 84.07 | Not recorded | 68fa72b01e209131cea57eb2 | | DGEDT-BERT | 84 | Not recorded | 68fa72b01e209131cea57eb2 | | DGEDT | 84 | Not recorded | 68fa72f11e209131cea59707 | | GPT-3.5 Turbo | 84 | Not recorded | 68fa72f11e209131cea59707 | | TGCN-BERT | 83.38 | Not recorded | 68fa72b01e209131cea57eb2 | | SK-GCN-BERT | 83.2 | Not recorded | 68fa72b01e209131cea57eb2 | | InstructABSA1 | 83.02 | Not recorded | 68fa73691e209131cea5c4fe | | RoBERTa | 78.06 | Not recorded | 68fa72b01e209131cea57eb2 | | RACL-BERT | 74.91 | Not recorded | 68fa73691e209131cea5c4fe | | Dual-MRC | 73.59 | Not recorded | 68fa73691e209131cea5c4fe | ### IT-RER-ABSA Accuracy: 94.31. Result ID: 6992c92d3a6c314849117dd9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"k":4}. This record does not assert independent reproduction. ### LSAE-X-DeBERTa Accuracy: 91.85. Result ID: 6992504a3a6c3148490e1a9a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"X-DeBERTa"}. This record does not assert independent reproduction. ### LSAT-X-DeBERTa Accuracy: 91.09. Result ID: 6992504a3a6c3148490e1a98. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"X-DeBERTa"}. This record does not assert independent reproduction. ### LSAS-X-DeBERTa Accuracy: 90.63. Result ID: 6992504a3a6c3148490e1a99. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"X-DeBERTa"}. This record does not assert independent reproduction. ### COLA Accuracy: 90.5. Result ID: 699289433a6c3148490f9db0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Zero-shot Methods"}. This record does not assert independent reproduction. ### LSAP-X-DeBERTa Accuracy: 89.98. Result ID: 6992504a3a6c3148490e1a97. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"X-DeBERTa"}. This record does not assert independent reproduction. ### LSAT-DeBERTa Accuracy: 89.61. Result ID: 6992504a3a6c3148490e1a94. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction. ### LSAE-DeBERTa Accuracy: 89.47. Result ID: 6992504a3a6c3148490e1a96. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction. ### LSAS-DeBERTa Accuracy: 89.42. Result ID: 6992504a3a6c3148490e1a95. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction. ### LSAP-DeBERTa Accuracy: 89.05. Result ID: 6992504a3a6c3148490e1a93. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction. ### LSAE-RoBERTa Accuracy: 88.39. Result ID: 6992504a3a6c3148490e1a92. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction. ### LSAS-RoBERTa Accuracy: 88.31. Result ID: 6992504a3a6c3148490e1a91. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction. ### SARL-RoBERTa Accuracy: 88.19. Result ID: 6992504a3a6c3148490e1a87. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction. ### DeBERTa Accuracy: 87.5. Result ID: 6992504a3a6c3148490e1a89. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction. ### LSAP-RoBERTa Accuracy: 87.01. Result ID: 6992504a3a6c3148490e1a8f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction. ### LSAT-RoBERTa Accuracy: 86.64. Result ID: 6992504a3a6c3148490e1a90. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction. ### SARL-DeBERTa Accuracy: 86.53. Result ID: 6992504a3a6c3148490e1a8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction. ### LSAE-BERT Accuracy: 85.56. Result ID: 6992504a3a6c3148490e1a8e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction. ### dotGCN Accuracy: 85.2. Result ID: 699289433a6c3148490f9dae. [Reporting paper]() Recorded evaluation configuration: {"Category":"Labeled Data Dependent Methods"}. This record does not assert independent reproduction. ### LSAT-BERT Accuracy: 84.93. Result ID: 6992504a3a6c3148490e1a8c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction. ### InstructABSA2 Accuracy: 84.5. Result ID: 6992c92d3a6c314849117dd8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LSAS-BERT Accuracy: 84.22. Result ID: 6992504a3a6c3148490e1a8d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction. ### LSAP-BERT Accuracy: 84.07. Result ID: 6992504a3a6c3148490e1a8b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction. ### DGEDT-BERT Accuracy: 84. Result ID: 6992504a3a6c3148490e1a85. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction. ### DGEDT Accuracy: 84. Result ID: 699289433a6c3148490f9dad. [Reporting paper]() Recorded evaluation configuration: {"Category":"Labeled Data Dependent Methods"}. This record does not assert independent reproduction. ### GPT-3.5 Turbo Accuracy: 84. Result ID: 699289433a6c3148490f9daf. [Reporting paper]() Recorded evaluation configuration: {"Category":"Zero-shot Methods"}. This record does not assert independent reproduction. ### TGCN-BERT Accuracy: 83.38. Result ID: 6992504a3a6c3148490e1a86. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction. ### SK-GCN-BERT Accuracy: 83.2. Result ID: 6992504a3a6c3148490e1a84. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction. ### InstructABSA1 Accuracy: 83.02. Result ID: 6992c92d3a6c314849117dd7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RoBERTa Accuracy: 78.06. Result ID: 6992504a3a6c3148490e1a88. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction. ### RACL-BERT Accuracy: 74.91. Result ID: 6992c92d3a6c314849117dd5. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Dual-MRC Accuracy: 73.59. Result ID: 6992c92d3a6c314849117dd6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.