SWDE
Benchmarks
TaskDatasetSOTA resultTrendResults
SWDE
91.09Performance
126
SWDE expanded (test)
96.07Precision
32
SWDE original (test)
97.04Precision
32
SWDE
92.1Accuracy
28
SWDE
62.5Accuracy
13
SWDE
94.78F1 Score
12
SWDE all domains (test)
88.1F1 Score
10
SWDE 2048 tokens
53.1Accuracy
8
SWDE (test)
80.7Movie Accuracy
8
SWDE University
77.5Pair F1
8
SWDE Movie
0.875Pair F1
8
SWDE
0.164Accuracy
5
SWDE
94.6Movie Accuracy
4
SWDE
21.1Contains Score
3
SWDE (Overall)
88.69F1 Score
2
SWDE (Non-Univ.)
95.18Precision
2
SWDE (Univ. split)
99.55Precision
2