MRPC
Benchmarks
TaskDatasetSOTA resultTrendResults
MRPC
0.1Empirical Error G(W)
90
MRPC
90.43Accuracy
90
MRPC
89.9Avg Accuracy
89
MRPC
76.2Accuracy
68
MRPC (test)
78.36F1 (micro)
44
MRPC GLUE (val)
85.54Accuracy
27
MRPC (test)
91.3Test Accuracy
24
MRPC
0Delta Accuracy
24
MRPC
-4.73Delta 1
24
MRPC (test)
89.46Accuracy
14
MRPC
88Utility Accuracy
12
MRPC
30.87Spearman Correlation (x100)
12
MRPC Near OOD
80.2Accuracy
10
MRPC (test)
87.86Accuracy
10
MRPC
0.65Kendall Correlation
10
MRPC (test)
81.2Macro F1
9
MRPC
87.05AP
6
MRPC
69.5MRPC Accuracy
6
NO-MRPC NLEBench (test)
73.7Accuracy
6
MRPC
86.52Accuracy
6
MRPC (val)
93.8F1 Score
6
MRPC (dev)
91F1 Score
6
MRPC
70Success Rate
5
MRPC
76Accuracy
5
MRPC GLUE (test)
88F1 Score
5