GLUE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GLUE v2 (dev)
93.3SST-2 Score
4
GLUE
64.6CoLA Score
3
GLUE
94.8Accuracy (SST-2)
3
GLUE MNLI
90.6Accuracy
3
GLUE
56CoLA Score
3
GLUE fine-tuning
93.7SST-2 Accuracy
3
GLUE (test)
82.44SST-2 Accuracy
3
GLUE
47.49CoLA MCC
3
GLUE (test)
61.1CoLA MCC
3
GLUE
87.8MRPC Accuracy
3
GLUE
71.48CoLA Score
3
GLUE (val test)
92.9SST-2 Accuracy
3
GLUE clean (test)
79RTE Accuracy
3
GLUE (val)
0.867QNLI
3
GLUE 2018 (test dev)
87.7MNLI
3
GLUE full latest (train)
95SST-2 Accuracy
3
GLUE STS-B
66Params (M)
3
GLUE (test)
80.5GLUE Score
3
GLUE (val)
68.69SST-2 Accuracy
2
GLUE
80.46RTE Accuracy
2
GLUE
65.3RTE Accuracy
2
GLUE
19.6QNLI Time (s)
2
GLUE (val)
66.1CoLA
2
GLUE Singaporean
20.3CoLA MCC
2
GLUE Nigerian
0.272CoLA Score
2