ScienceWorld
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ScienceWorld
69.97Success Rate
78
ScienceWorld Seen
88.8Success Rate
72
ScienceWorld (Unseen)
90.1Average Reward
34
ScienceWorld (unseen)
88.6Success Rate
32
ScienceWorld (seen)
89.7Success Rate
32
ScienceWorld Unseen
85.15Success Rate
32
ScienceWorld (Seen)
63.91Success Rate
31
ScienceWorld
100EM (Exact Match)
30
ScienceWorld
47.7Exact Match (EM)
30
ScienceWorld
0.319Mean Reward
30
ScienceWorld Unseen
66.3Success Rate
28
ScienceWorld Seen
69.8Success Rate
28
ScienceWorld
62Success Rate
28
ScienceWorld
70.2Average Score
27
ScienceWorld (test)
84.6Score
27
ScienceWorld
75.9Success Rate
26
ScienceWorld
15.44Success Rate
24
ScienceWorld (test)
51.51Success Rate
24
ScienceWorld Unseen (test)
58.94Success Rate
24
ScienceWorld (Seen)
89.5Average Reward
22
ScienceWorld
82.2Original Score
20
ScienceWorld Seen (val)
0.735Average Reward
20
ScienceWorld
52.8Matter Score
20
ScienceWorld Unseen
70.8Success Rate
18
ScienceWorld Seen
70.9Success Rate
18