AlfWorld
Benchmarks
TaskDatasetSOTA resultTrendResults
ALFWorld
0.767Mean Reward
30
ALFWorld
100Pick Success
30
ALFWorld (test)
97.9Reward
30
ALFWorld
93.28Success Rate
29
ALFWorld Unseen
88.1Success Rate (SR)
26
ALFWorld Seen
85Success Rate (SR)
26
ALFWorld (test)
96.27Success Rate
26
ALFWorld (test)
89.4Task Success Rate
24
AlfWorld
61.5Exact Match
24
AlfWorld
92Success Rate
24
AlfWorld (test)
97.01Success Rate
24
ALFWorld
85.16Success Rate
23
ALFWorld Unseen
89.6Average Accumulated Reward
23
ALFWorld
94.78Success Rate
22
AlfWorld
6.4Steps
22
ALFWorld (test)
97.7Success Rate
21
ALFWorld
63.65Average task-level performance
20
ALFWorld (in-distribution)
96.81Success Rate
20
ALFWorld
91Success Rate (Org.)
20
ALFWorld
99.1Pick Success Rate
20
ALFWorld unseen (test)
88.81Average Reward
20
ALFWorld (test)
91.79Overall Success Rate
20
ALFWorld (ALF) (test)
91Success Rate
19
ALFWorld
98.7Pick Success Rate
19
ALFWorld Unseen
99.3Pick&Place Success Rate
19