AlfWorld
Benchmarks
TaskDatasetSOTA resultTrendResults
ALFWorld
99.6Overall Success Rate
398
ALFWorld
97.5Overall Success Rate
183
ALFWorld
0.96Accuracy
151
ALFWorld
94Success Rate
106
ALFWorld
89.3Accuracy
82
ALFWorld (test)
96.87Success Rate
81
ALFWorld
100Pick Success Rate
72
ALFWorld Unseen
97.76Success Rate
67
ALFWorld (val seen)
88.57Success Rate (SR)
65
ALFWorld (test)
91.4Success Rate
55
ALFWorld Unseen
86.68Success Rate
54
ALFWorld
100Pick Success Rate
54
ALFWorld
100Success Rate
51
ALFWorld held-out (test)
95.5Score
49
ALFWorld Seen
97.86Success Rate
47
ALFWorld
76.02Success Rate
45
ALFWorld Unseen
79.1Success Rate
40
AlfWorld
86.7Success Rate
40
AlfWorld
99.3Average Success Rate
38
ALFWorld
98.9Pick Success Rate
36
ALFWorld Seen (val)
100Pick Reward
33
ALFWorld (test)
100Success Rate (Pick)
31
ALFWorld (Unseen)
91.8Average Reward
31
ALFWorld (Seen)
90.2Average Reward
31
ALFWorld
100Success Rate
31