ScienceQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ScienceQA full
75.85Accuracy
10
ScienceQA-IMG (test)
84.58Accuracy
9
ScienceQA IMG
69.5EM
9
ScienceQA
40.1Average Accuracy
9
ScienceQA (val)
97Accuracy
9
ScienceQA
55DACC
8
ScienceQA (test)
4.5Steps
8
ScienceQA
3.41Speedup Ratio
8
ScienceQA
89.4Accuracy
8
ScienceQA (val)
98.2Accuracy
8
ScienceQA I
69.96Accuracy
8
ScienceQA text-only
96.2Accuracy
7
ScienceQA 60 (test)
0.99AUROC
6
ScienceQA (out-of-distribution)
89.04Accuracy
6
ScienceQA
89.92Accuracy
6
ScienceQA 2022 (val)
98.2Accuracy
6
ScienceQA
75.1SQA^I Score
6
ScienceQA
0.96Kendall's Tau
5
ScienceQA Few-shot
33.9IK-IK Score
5
ScienceQA SQA^I
90.5Accuracy
5
ScienceQA
63.56Accuracy
4
SQAI ScienceQA-Image
69.5Accuracy
4
ScienceQA
82.3Accuracy
4
ScienceQA curated subset (324 questions) (test)
86.46Accuracy
4
ScienceQA (SQA) (test)
70.2SQA Accuracy
4