ScienceQA
Benchmarks
TaskDatasetSOTA resultTrendResults
ScienceQA
99.8Accuracy
916
ScienceQA
98.18Accuracy
525
ScienceQA IMG
98.2Accuracy
357
ScienceQA (SQA)
97.4Accuracy
338
ScienceQA image
98Accuracy
281
ScienceQA (test)
98.3Average Accuracy
273
ScienceQA SQA-IMG
92.8Accuracy
186
ScienceQA IMG
95.78Accuracy
152
ScienceQA SQA-I
96.6Accuracy
149
ScienceQA img
86.2Accuracy
135
ScienceQA (test)
98.2Accuracy
115
ScienceQA
98.8Accuracy
106
ScienceQA image
75.1Accuracy
89
ScienceQA
96.21Score
86
ScienceQA
94.4Accuracy
83
ScienceQA IMG (test)
98.4Accuracy
74
ScienceQA (test)
92.53Accuracy
73
ScienceQA Image
95.6Score
70
ScienceQA
88.6IMG Score
64
ScienceQA
97.8Accuracy
61
ScienceQA (SQA)
89.3SQA Accuracy
60
ScienceQA
97.85Average Accuracy
45
ScienceQA Image (test)
96.2Accuracy
45
ScienceQA (SQAI)
74.2Accuracy
42
ScienceQA out-of-scope (test)
0Refusal Rate
40