IndustryOR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
IndustryOR
69.1Pass@1 (SA)
42
IndustryOR
76Accuracy
40
IndustryOR
57Accuracy (pass@1)
23
IndustryOR
61Accuracy Rate
20
IndustryOR (Indus.OR)
5Error Rate
19
IndustryOR
63.7Accuracy
17
IndustryOR
84.34SA Score
15
IndustryOR
63.8Accuracy
12
IndustryOR
45SA Score
11
IndustryOR
89.9Accuracy
11
IndustryOR
69.1Accuracy (%)
11
IndustryOR
8.64Average Run Time (s)
9
IndustryOR (test)
75Success Rate (SA)
8
IndustryOR Text2Zinc
92Execution Accuracy (Eacc)
8
IndustryOR 83 samples (test)
57.83Success Rate
7
IndustryOR
59.4Inference Time
6
IndustryOR Cleaned (test)
52.3Solving Accuracy
5
IndustryOR (Standard)
63Accuracy
5
IndustryOR
76.19Accuracy
4
IndustryOR Curated (SIRL)
76Accuracy
2