SemEval
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SemEval Task 3 Track A Subtask 1 2026 (test)
1.268RMSEVA (eng-res)
5
SemEval Task 11 Subtask 4 2026 (test)
100Accuracy
5
SemEval Task 11 Subtask 2 2026 (test)
100Accuracy
5
SemEval-2026 Task 11 Subtask 1 (test)
100Accuracy
5
SemEval Task 11 Subtask 3 2026 (test)
100Accuracy
5
SemEval Task 4 Track A 2026 (dev)
81Accuracy
5
SemEval Cross-domain ASTE 2014, 2015, 2016 (test)
53.64Performance (R14->L14)
5
SemEval 2012
23.4Spearman Correlation
5
SemEval Laptop 2014
87.4F1 Score
5
SemEval Task 5 Sub-task 1 2016 (test)
88.7Accuracy
5
SemEval Task 7 Sub-Task 1.1 2018 (test)
81.7Macro F1
5
SemEval Task 11 2018 (test)
0.895Accuracy
5
SemEval Task 13 2015
0.724Acc (comb)
5
SemEval Task 4 2026 (test)
63.25Accuracy
4
SemEval Task 2 Subtask 2A 2026 (test)
0.675Valence Correlation (r)
4
SemEval Task 6 2026 (Evaluation)
85.05Macro F1 Score
4
SemEval Task 6 2026 (dev)
81Macro F1 Score
4
SemEval Task 5 (English) 2021 (test)
70.8F1 Score
4
SemEval Task 10 2026 (dev)
79Macro F1
4
SemEval ATE subtask (test)
92.9Laptop 2014
4
SemEval-8 (val)
76.1MicF1
4
SemEval 8 (PH)
78Micro F1
4
SemEval Task 1 EN Sub-task 2 2020
0.731Spearman Correlation
4
SemEval (OOD)
87.09Accuracy
4
SemEval Task 12 2022 (test)
47.02Precision
4