GLUE
Benchmarks
TaskDatasetSOTA resultTrendResults
GLUE
156SST-2
551
GLUE (dev)
97.36SST-2 (Acc)
529
GLUE (test)
97.9SST-2 Accuracy
416
GLUE (val)
97.4SST-2
201
GLUE (test dev)
93.45MRPC Accuracy
90
GLUE
89.5Average Score (GLUE)
76
GLUE (test)
7,564.6QNLI
75
GLUE
92.5Accuracy
75
GLUE
97.3SST-2 Accuracy
62
GLUE CoLA, MRPC, RTE, SST-2
75.9Absolute Accuracy
60
GLUE (test val)
94MRPC Accuracy
59
GLUE
95.18SST-2
55
GLUE (val)
82.4CoLA Score
54
GLUE (test)
94.9QNLI
47
GLUE
69.3COLA Score
41
GLUE v1 (test dev)
87.86MNLI
40
GLUE 1.0 (test)
97.8SST-2 (Acc)
37
GLUE
89.1Accuracy (SST-2)
33
GLUE (test)
95.64SST-2 Accuracy
33
GLUE
94.1Accuracy
32
GLUE small
73.4CoLA Mcc
32
GLUE
3.56SST-2 Speedup
32
GLUE
3.06SST-2 Speedup
32
GLUE (test)
82.2MNLI Score
30
GLUE
100Average GLUE Score
30