# Sentiment Analysis on SemEval English 2017 (test) Source: [Sentiment Analysis on SemEval English 2017 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:51:34.912Z Evaluation of general Sentiment Analysis performance on the test split of the SemEval English 2017 dataset, measured using Macro-F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Sentiment Analysis | | Dataset (including any stated split) | SemEval English 2017 (test) | | Metric | Macro-F1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 15 of 15 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Macro-F1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Macro-F1 | Result date | Report paper | | --- | --- | --- | --- | | Unsupervised + supervised majority voting | 75.86 | Not recorded | 692e72a6d6b0dd33429323ab | | LSTM | 74.84 | Not recorded | 692e72a6d6b0dd33429323ab | | Supervised majority voting | 74.42 | Not recorded | 692e72a6d6b0dd33429323ab | | CNN | 73.73 | Not recorded | 692e72a6d6b0dd33429323ab | | SVM | 73.48 | Not recorded | 692e72a6d6b0dd33429323ab | | SVM | 72.02 | Not recorded | 692e72a6d6b0dd33429323ab | | XLM-T | 70.63 | Not recorded | 68fa6c881e209131cea34843 | | XLM-R | 68.52 | Not recorded | 68fa6c881e209131cea34843 | | XLM-R | 68.18 | Not recorded | 68fa6c881e209131cea34843 | | XLM-T | 67.47 | Not recorded | 68fa6c881e209131cea34843 | | XLM-T | 66.89 | Not recorded | 68fa6c881e209131cea34843 | | XLM-R | 65.07 | Not recorded | 68fa6c881e209131cea34843 | | Semi-supervised | 63.45 | Not recorded | 692e72a6d6b0dd33429323ab | | Unsupervised | 61.13 | Not recorded | 692e72a6d6b0dd33429323ab | | FT | 50.85 | Not recorded | 68fa6c881e209131cea34843 | ### Unsupervised + supervised majority voting Macro-F1: 75.86. Result ID: 6996d4785698665ec420cd32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"unsupervised\_coeff":0.4,"supervised\_coeff":0.6}. This record does not assert independent reproduction. ### LSTM Macro-F1: 74.84. Result ID: 6996d4785698665ec420cd34. [Reporting paper]() Recorded evaluation configuration: {"mode":"Non-static"}. This record does not assert independent reproduction. ### Supervised majority voting Macro-F1: 74.42. Result ID: 6996d4785698665ec420cd31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CNN Macro-F1: 73.73. Result ID: 6996d4785698665ec420cd33. [Reporting paper]() Recorded evaluation configuration: {"mode":"Non-static"}. This record does not assert independent reproduction. ### SVM Macro-F1: 73.48. Result ID: 6996d4785698665ec420cd30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"features":"3-feats technique"}. This record does not assert independent reproduction. ### SVM Macro-F1: 72.02. Result ID: 6996d4785698665ec420cd2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"features":"tf-idf"}. This record does not assert independent reproduction. ### XLM-T Macro-F1: 70.63. Result ID: 698f202a3a6c314849f60298. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Training Setting":"Multilingual"}. This record does not assert independent reproduction. ### XLM-R Macro-F1: 68.52. Result ID: 698f202a3a6c314849f60297. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Setting":"Multilingual"}. This record does not assert independent reproduction. ### XLM-R Macro-F1: 68.18. Result ID: 698f202a3a6c314849f60293. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Setting":"Monolingual"}. This record does not assert independent reproduction. ### XLM-T Macro-F1: 67.47. Result ID: 698f202a3a6c314849f60296. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Training Setting":"Bilingual","Bilingual Transfer Source Language":"Es"}. This record does not assert independent reproduction. ### XLM-T Macro-F1: 66.89. Result ID: 698f202a3a6c314849f60294. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Training Setting":"Monolingual"}. This record does not assert independent reproduction. ### XLM-R Macro-F1: 65.07. Result ID: 698f202a3a6c314849f60295. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Setting":"Bilingual","Bilingual Transfer Source Language":"It"}. This record does not assert independent reproduction. ### Semi-supervised Macro-F1: 63.45. Result ID: 6996d4785698665ec420cd2e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Unsupervised Macro-F1: 61.13. Result ID: 6996d4785698665ec420cd2d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### FT Macro-F1: 50.85. Result ID: 698f202a3a6c314849f60292. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Training Setting":"Monolingual"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.