AlfWorld
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ALFWorld Seen
96.5Pick & Place Success Rate
19
ALFWorld (val)
100Pick Success Rate
19
ALFWorld (val_seen)
97.7Pick Success Rate
18
ALFWorld (OOD)
56.43Success Rate
18
ALFWorld ID
94.3Pick Success Rate
18
ALFWorld
96.8Task Completion Rate (Short)
18
ALFWorld Seen
85.7Success Rate (%)
18
AlfWorld
2.78Mean Normalised Score
18
AlfWorld
100Unlearn Efficacy
18
ALFWorld (val-unseen)
94.1Success Rate
18
ALFWorld
100CoT Match Rate
18
ALFWorld
47.9Average Reasoning Length (tokens)
18
ALFWorld
100Look Success
18
ALFWorld
97Success Rate
17
ALFWorld (test)
100Pick Success Rate
17
AlfWorld (AW) (test)
1,040Loop Ratio
17
ALFWorld (test)
98.7Success Rate (Avg)
17
ALFWorld OOD
40.8Success Rate (SR)
16
ALFWorld IID
43.57Success Rate (SR)
16
AlfWorld (test)
89Token F1
16
ALFWorld (test)
85.7Pick Success Rate
16
ALFWorld (IOD)
96.67Accuracy
16
ALFWorld (All tasks)
96Overall Success Rate
16
ALFWorld (AW)
99.87EM Accuracy
16
ALFWorld (ID and OOD)
92.86Success Rate
16