CoLA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CoLA
85.91Accuracy (CoLA)
108
CoLA (test)
86.34Avg Accuracy
56
CoLA
0.25Generalization Error Approximation (G(W))
40
CoLA
0.1Total Runtime (hours)
36
CoLA
100AUC
32
CoLA
99.6ROUGE-1
32
CoLA
100ROUGE-1
32
Cola
81.6ROC-AUC
31
COLA
83.43Accuracy
31
CoLA
100ROUGE-1
24
CoLA out-of-domain (dev test)
84.9Accuracy
24
CoLA
3Average per-batch runtime (seconds)
20
CoLA (test)
61.21MCC
18
CoLA
77.7Exact Match
14
CoLA (held-out)
46.8F1 Score
14
Cola (test)
83.88Multi-Obj Acc
14
CoLA max length 14 (val)
75.7ARR
14
CoLA
85Utility Accuracy
12
CoLA
96.3ROUGE-L
12
CoLA English (IDD)
88.2Accuracy
12
CoLA in-domain (dev)
88.6Accuracy
12
CoLA
86.26Accuracy
10
Cola
33.33Txt2Img Score
10
CoLA GLUE (val)
84.76Accuracy
9
CoLA full (test)
86.4Accuracy
9