GLUE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GLUE
97.1SST-2 Accuracy
17
GLUE
88.2CoLA Score
16
GLUE
85.59MNLI Accuracy
16
GLUE
56MNLI Accuracy
16
GLUE standard (test val)
69.86CoLA Accuracy
16
GLUE RoBERTa-base (val)
60.18CoLA Score
16
GLUE
76.98CoLA
16
GLUE (test)
95.8SST-2 Score
15
GLUE
66.7CoLA Accuracy
15
GLUE
63.1CoLA Score
15
GLUE 1.0 (dev)
95.3SST-2 (Acc)
15
GLUE
82.59RTE Accuracy
14
GLUE
96.5SST-2 Accuracy
14
GLUE
95.2SST-2 Accuracy
14
GLUE
76.98CoLA
14
GLUE
87.7Average Test Accuracy (S1)
14
GLUE
91.9MNLI Accuracy
13
GLUE
84.7MNLI-m Accuracy
13
GLUE DeBERTaV3-base (test)
72.03CoLA Score
13
GLUE
95.4SST-2 Accuracy
13
GLUE
85MRPC Score
13
GLUE
81.2RTE Accuracy
13
4GLUE
21.3Average Backward Transfer (BWT)
13
GLUE RTE
8.8Execution Time (s)
13
GLUE standard (val test)
94.6SST-2 Accuracy
13