ChemBench
Benchmarks
TaskDatasetSOTA resultTrendResults
ChemBench
67.86Pass@1
20
ChemBench (test)
66Initial Score
13
ChemBench
86.1Overall Score
11
ChemBench Technical chemistry
0.86Spearman Correlation
8
ChemBench Physical chemistry
0.74Spearman Correlation
8
ChemBench Organic chemistry
0.89Spearman Correlation
8
ChemBench Material science
0.42Spearman Correlation
8
ChemBench Inorganic chemistry
0.67Spearman Correlation
8
ChemBench Analytical chemistry
0.86Spearman Correlation
8
ChemBench4K
93.66Product
7
ChemBench
58.4Accuracy
6
ChemBench out-of-distribution
65.67Top-1 Accuracy
4
ChemBench
83.3Score
3
ChemBench Overall
90.5Success
1
ChemBench Toxicity and Safety
90.1Success Rate
1
ChemBench Technical Chemistry
0.825Success Rate
1
ChemBench Physical Chemistry
8,420Success
1
ChemBench Organic Chemistry
92.1Success
1
ChemBench Materials Science
90.5Success Rate
1
ChemBench Inorganic Chemistry
91.3Success Rate
1
ChemBench General Chemistry
0.872Success Rate
1
ChemBench Chemical Preference
93.1Success Rate
1
ChemBench Analytical Chemistry
82.2Success Rate
1