SemEval
Benchmarks
TaskDatasetSOTA resultTrendResults
SemEval-2010 Task 8 (test)
91.9F1 Score
128
SemEval
91.9Micro-F1
63
SemEval Laptop 2014 (test)
86.46Accuracy
59
SemEval (test)
90.4Micro F1
55
SemEval Task 1 Subtask 2 English 2020
0.774Spearman Correlation
54
SemEval Task 1:E-c 2018 (test)
57.8Macro F1
53
SemEval
69.5Score
46
SemEval Subtask 1
92.11F1 Score
44
SemEval 2017
27.39F1@5
42
SemEval-2007 Task 17 (test)
71.4F1 Score
36
SemEval 2010
37.5F1 Score (k=10)
31
SemEval 2016
67.44FR Score
30
SemEval Task 4 Subtask 2 Restaurant domain 2014 (test)
91.76Accuracy
30
SemEval Task 7 (S7-T7) 2007 (test)
90.6F1 Score
29
SemEval Subtask 1 (English) 2020
0.73Accuracy
28
SemEval res 2015 (test)
79.18Precision
28
SemEval Laptop (SL) (test)
0.707F1 Score
28
SemEval res 2016 (test)
89.2Precision
27
14lap SemEval 2014 (test)
82.4Precision
27
SemEval (test)
66.2ASR
26
SemEval Task 13 Subtask A 2026 official (test)
78.9Macro F1
24
SemEval 2018
71.4Accuracy
24
SemEval (test)
0.887F1 (micro)
24
SemEval Task 8 2010 (test)
90.36F1 Score
24
SemEval Sci 2016 (test)
64.7Accuracy
23