SemEval
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SemEval Env 2016 (test)
67.3Accuracy
23
SemEval
12Total Count
22
SemEval 2017
54F1 Score @ 10
22
Semeval Task 10 2018
76F1 Score
20
SemEval Laptop 2014
85.16F1 Score
19
SemEval Restaurant 2014 (All)
87.45F1 Score
19
SemEval Task 4 Laptop 2014 (test)
88Accuracy
19
SemEval Task 13 2015 (test)
76.2F1
19
SemEval Task 12 2013 (test)
71.1F1 Score
19
SemEval 2013 WSI Task 13 (test)
64F-BC
19
SemEval Restaurant 2016 (test)
82.56F1 Score
18
SemEval Restaurant 2015 (test)
0.766F1 Score
18
SemEval 2017 (OOD)
82.39Accuracy
18
SemEval Task 9 2026 (test)
88.92Macro-F1
17
SemEval
91.45Accuracy
17
SemEval Task 18 Brown corpus OOD 2015
88.9Average LF1
17
SemEval
87.81Micro-F1
17
SemEval-15 (SE15) 3.0 (test)
84.4F1 Score
16
SemEval-13 (SE13) 3.0 (test)
81.2F1 Score
16
SemEval 2010 WSI Task 14 (test)
71.3F-Score
16
SemEval
15Total Count
15
SemEval 2017
45.37Hierarchical F1
15
SemEval Food 2016 (test)
58.7Accuracy
15
semeval RE
76Relation Strict F1
15
SemEval English 2017 (test)
75.86Macro-F1
15