AlfWorld
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ALFWorld Clarification (test)
68.9Success Rate
15
ALFWORLD
1Effective Steps Multiplier
15
ALFWorld v1.0 (test)
100Pick Success Rate
15
ALFWorld (in-distribution)
90.5Success Rate
14
ALFWorld
91Real Success
14
ALFWorld Seen v1 (in-distribution)
57.14Average Success Rate
14
Alfworld
97.76Success Rate
13
ALFWorld OOD
92Success Rate
13
ALFWorld out-of-distribution (test)
95.93Task Success Rate
13
ALFWorld (Seen)
84.65Average Reward
12
ALFWorld cleaned 100-task v3 (mix of val-seen and val-unseen)
97Success Rate
12
ALFWorld OOD (test)
96Pick Success Rate
12
ALFWorld Unseen
90.3Average Reward
12
ALFWorld Seen
87.2Average Reward
12
ALFWorld official (val)
65.3Success Rate
12
ALFWorld (out-of-distribution)
75Put Success Rate
12
ALFWorld
87.1Success Rate
12
ALFWorld Text Aligned (N=134 unseen tasks)
98.5Success Rate
11
ALFWorld Seen
90.7Average Accumulated Reward
11
ALFWorld unseen (val)
70.8Pick Success Rate
11
ALFWorld
60.21Success Rate
11
ALFWorld Continual-memory deployment
60.2Success Rate
11
ALFWorld
96Pick Success Rate
11
ALFWorld Hard
20.66Success Rate (SR)
11
ALFWorld Unseen (val)
79.19Success Rate (SR)
11