ALFRED
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ALFRED unseen (val)
9.7Task Success Rate
6
ALFRED seen (val)
33.7Task Success Rate
6
ALFRED (val seen)
46.59SR
6
ALFRED (Q3)
54.8Accuracy
5
ALFRED (Q2)
89.5Accuracy
5
ALFRED (Q1)
92.5Accuracy
5
ALFRED
91Average Task Success Rate
5
ALFRED
55.4Episode Accuracy
4
ALFRED
71.2TSR
4
ALFRED
78.5TSR (%)
4
ALFRED
84Task Success Rate (TSR)
4
ALFRED (val unseen)
91Exact Match
4
ALFRED (val unseen)
64EM
4
ALFRED
0.53Avg Completion Rate
4
ALFRED Unseen (val)
20Task Success Rate (TSR)
3
ALFRED seen (val)
3.4Task Success Rate (SR)
3
ALFRED (Seen)
33.5Success Rate (SR)
3