GLUE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GLUE
85.78SST-2 Accuracy
8
GLUE
88.92SST-2 Accuracy
8
GLUE
76.8CoLA Score
8
GLUE
71.69CoLA
8
GLUE
80.9Red Score
8
GLUE
96.67SST-2 Accuracy
8
GLUE i.i.d. distribution (val)
0.927MRPC
8
GLUE (val)
66.3CoLA Score
7
GLUE (val)
60.8CoLA Score
7
GLUE
69.8CoLA Accuracy
7
GLUE
11.01CoLA Score
7
GLUE
96.1SST-2 Accuracy
7
GLUE (test)
96.1SST-2 Accuracy
7
GLUE Frozen (val)
76.9MNLI
6
GLUE (val)
74.6RTE Accuracy
6
GLUE
92.55SST-2 Accuracy
6
GLUE
55.5CoLA Score
6
GLUE 2018 (test)
88.5QNLI Accuracy
6
GLUE
90.49MNLI Accuracy
6
GLUE (val)
92.43SST-2 Accuracy
6
GLUE (test)
96.15SST-2 Score
6
GLUE (test)
86.89MNLI Accuracy
6
GLUE (test)
45.28CoLA Inference Time (s)
6
GLUE
91.17SST-2 Accuracy
6
GLUE
87.67MNLI
6