AlfWorld
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ALFWorld (Unseen)
0.836Average Reward
5
ALFWorld Seen
81.29Success Rate
5
ALFWorld 134 scenes (OOD)
93.28SC@7
5
ALFWorld 140 scenes (IID)
97.14Success Count @ 7 Steps
5
ALFWorld
97.2Pick Success Rate
5
ALFWorld unseen domains
71.58SR
5
ALFWorld unseen domains 5-shot
71.88Success Rate
5
ALFWorld 1-shot (unseen domains)
71.28Success Rate (SR)
5
ALFWorld unseen (val)
100Success Rate (SR)
4
ALFWorld (val)
82.8Success Rate
4
ALFWorld (test)
94.23Success Rate
4
ALFWorld (out domain)
89Success Rate
4
ALFWorld in domain
95Success Rate
4
ALFWorld In-domain
97Score
4
ALFWorld (OOD)
58.7Score
4
ALFWorld full 134-task (evaluation suite)
100FSR
4
ALFWorld (post-training evaluation)
43.9Rollout Length
3
ALFWorld 134 (test)
77.4Success Rate
3
ALFWorld
35Tolerant Accuracy (±1 step)
2
ALFWorld
2.5Rollout Speedup Factor
2
ALFWorld (val_seen)
15,527Total Wall-Clock Time (s)
2
ALFWorld
0.506Scalar Regret
1
ALFWorld
22Effect Score
1