GLUE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GLUE
88.97MRPC Score
10
GLUE
87.63CoLA Accuracy
10
GLUE MNLI-m, QNLI, SST-2, MRPC
87.6MNLI-m Accuracy
10
GLUE (val)
85.7MRPC Accuracy
9
GLUE 8 tasks
75CoLA Score
9
GLUE fine-tuning base
96GPU Utilisation
9
GLUE
95.88SST-2 Accuracy
9
GLUE
90.65MNLI Accuracy
9
GLUE
83.4MNLI Accuracy
9
GLUE
69.9RTE Accuracy
9
GLUE
94.4SST-2 Accuracy
9
GLUE large tasks (dev)
94.1SST-2 Score
9
GLUE
86.7COLA
9
GLUE
95.64SST-2
9
GLUE v1 (test dev)
96.22SST-2 Accuracy
9
GLUE MNLI, QQP, QNLI, SST2 (Matched, Mismatched, dev)
85.91MNLI-m Accuracy
9
GLUE SST-2, QQP, MNLI-m, MNLI-mm official (test)
94.9SST-2 Accuracy
9
GLUE (test)
69.7CoLA Score
8
Glue QQP
91.89Exact Match (EM)
8
GLUE v1.0 (test)
81.06QNLI Accuracy
8
GLUE RoBERTa-Base (test)
58.21CoLA Acc
8
GLUE
39.93QQP Accuracy
8
GLUE
88.15MNLI Accuracy
8
GLUE large
83.5MNLI Accuracy
8
GLUE
91.51SST-2 Accuracy
8