CoLA
Benchmarks
TaskDatasetSOTA resultTrendResults
CoLA
85.91Accuracy (CoLA)
108
CoLA (test)
86.34Avg Accuracy
56
CoLA
0.25Generalization Error Approximation (G(W))
40
CoLA
0.1Total Runtime (hours)
36
CoLA
100AUC
32
CoLA
99.6ROUGE-1
32
CoLA
100ROUGE-1
32
Cola
81.6ROC-AUC
31
COLA
83.43Accuracy
31
CoLA
100ROUGE-1
24
CoLA out-of-domain (dev test)
84.9Accuracy
24
CoLA
3Average per-batch runtime (seconds)
20
CoLA (test)
61.21MCC
18
CoLA
77.7Exact Match
14
CoLA (held-out)
46.8F1 Score
14
Cola (test)
83.88Multi-Obj Acc
14
CoLA max length 14 (val)
75.7ARR
14
CoLA
85Utility Accuracy
12
CoLA
96.3ROUGE-L
12
CoLA English (IDD)
88.2Accuracy
12
CoLA in-domain (dev)
88.6Accuracy
12
CoLA
86.26Accuracy
10
Cola
33.33Txt2Img Score
10
CoLA GLUE (val)
84.76Accuracy
9
CoLA full (test)
86.4Accuracy
9