SemEval
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SemEval-2013 Task 12 (nouns)
72.8F1 (Nouns)
7
SemEval coarse-grained English all-words 2007 (test)
79.68F1 Score
7
SemEval-2026 Task 4 (test)
67Accuracy
6
SemEval (test)
89.75Accuracy
6
SemEval Task 13 2026 (test)
65.62Macro-F1
6
SemEval Task 2 Subtask 2A 2026 (dev)
0.626Valence Correlation (r)
6
SemEval-2018 E-c ES (test)
46.7F1 Score
6
SemEval E-c AR 2018 (test)
52F1 Score
6
SemEval E-c EN 2018 (test)
43.6F1 Score
6
SemEval Science Task 13 2016 (test)
52.9Hit@1
6
SemEval Italian 2010 (test)
65.9Avg F1
6
SemEval Restaurant 2015
64.41Micro-F1
6
SemEval SDP PSD OOD 2015
83.4F1 Score
6
SemEval Restaurant 2016
0.813F1 Score
6
SemEval
0.026F1@5
6
SemEval
33.1F1@5
6
SemEval Task 4 Subtask 2 Restaurant domain 2014
86.2Accuracy
6
16res SemEval-2016 Task 5 (test)
68.58Precision
6
SemEval restaurant 14
89.3span-level micro-F1
6
SemEval-14 laptop
81.6Span Micro-F1
6
modified French SemEval 2013 (test)
53.53F1 (Single Mean)
6
SemEval Task 14 2010
0.713F-S
6
SemEval Task 4 2014 (test)
72.1Accuracy
6
SemEval 2014 Task 4 (test)
78.6Accuracy
6
SemEval Task 3 Subtask 3 English 2023 (test)
40.62F1 Score (Micro)
5