SemEval
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SemEval Task 9 Subtask 1 2026 (test)
0.9NEP Score
1
SemEval-2026 Task 9 tur (test)
0.784Accuracy
1
SemEval Task 9 tel 2026 (test)
88.9Accuracy
1
SemEval-2026 Task 9 swa (test)
78.3Accuracy
1
SemEval Task 9 (spa) 2026 (test)
76.3Accuracy
1
SemEval Task 9 pol 2026 (test)
81.2Accuracy
1
SemEval Task 9 fas 2026 (test)
87.1Accuracy
1
SemEval Task 9 (pan) 2026 (test)
76.9Accuracy
1
SemEval Task 9 ori 2026 (test)
83.8Accuracy
1
SemEval Task 9 (nep) 2026 (test)
88.2Accuracy
1
SemEval-2026 Task 9 hin (test)
89.6Accuracy
1
SemEval Task 9 mya 2026 (test)
88.9Accuracy
1
SemEval Task 9 ben 2026 (test)
84.7Accuracy
1
SemEval Task 9 arb 2026 (test)
83.2Accuracy
1
SemEval Task 9 (amh) 2026 (test)
82.4Accuracy
1
SemEval Task 10 2018 1.0 (test)
73.68F1
1
SemEval 2018 Task 10 1.0 (val)
0.728F1
1
SemEval-2018 Task 10 1.0 (train)
76.17F1
1
SemEval Task 8 Subtask A 2017 (test)
78.4Accuracy
1
SemEval SE02, SE03, SE13, SE15 Multiple Versions (test)
—F1 (Nouns)
0
SemEval-2002 (test)
—F1 Score
0
SemEval-2007 Task 17 (dev)
—F1 Score
0