QASC
Benchmarks
TaskDatasetSOTA resultTrendResults
QASC
89.6Score
36
QASC
100Accuracy
22
QASC (test)
78.5Accuracy
21
QASC
74.61Accuracy
15
QASC
74.17Recall@1
15
QASC (test)
73.5Accuracy
14
QASC (dev)
84.02Accuracy
14
QASC
0.803Cohen's d
12
QASC
0.273Spearman's rho
12
QASC
98.9Accuracy
11
QASC
0.803Cohen's d
10
QASC
14.73F1
10
QASC (dev)
67.61Accuracy
10
QASC Evaluation Set (5-fold cross-validation)
85Precision
9
QASC
14Leakage Error
9
QASC
17Initial Score
8
qasc
68.36Accuracy
7
QASC (dev)
83.7Accuracy
7
QASC (val)
99Exact Match (EM)
6
QASC (test)
90.06Accuracy
6
Scientific Commonsense (QASC) 1.0 (test)
53.04Accuracy
5
QASC MRQA few-shot
99.1F1 Score
5
QASC
72.8Accuracy
4
QASC
43Accuracy
2