Sciworld
Benchmarks
TaskDatasetSOTA resultTrendResults
SciWorld
95.9Accuracy
164
SciWorld
94.6Accuracy
41
SciWorld
88.9Accuracy
21
SciWorld (test)
96Token F1
16
SciWorld (SW)
98.64EM Accuracy
16
SciWorld
68.21Real
14
SciWorld
59.48Success Rate (SR)
14
SciWorld
98.4Success Rate @1
13
Sciworld
77.77Success Rate
13
SciWorld Seen
76.3Average Accumulated Reward
12
SciWorld
67.3Score
12
Sciworld
82.6Progress Rate
12
SciWorld
55.7Measure Score
10
SciWorld
73.5Success Rate (SR)
10
SciWorld
29.45Pass@1
10
SciWorld Unseen
82.4Success Rate
7
SciWorld (Seen)
86.4Success Rate
7
SciWorld
7.4Steps
7
SCIWorld (out domain)
44Success Rate
4
SCIWorld (in domain)
61Success Rate
4
SciWorld
69.1Average Reward
3