WiC
Benchmarks
TaskDatasetSOTA resultTrendResults
WiC
74.5Avg Accuracy
261
WiC
70.1Accuracy
52
WiC (test)
85.3Accuracy
34
WiC (dev)
89.5Accuracy
32
WiC v1.0 (test)
72.1Accuracy
19
WIC
71.5Accuracy
16
WiC SuperGLUE (val)
68.55Accuracy
9
WiC SuperGLUE (test dev)
0.72Accuracy
8
WIC SuperGLUE (test)
65.82Accuracy
8
WiC
57.1Accuracy (0-shot)
6