BabyAI
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
BabyAI
73Success Rate
37
BabyAI (test)
93.3Success Rate
25
BabyAI (test)
93Token F1
16
BabyAI
72.56Success Rate
14
BabyAI BossLevel
96.2Success Rate
14
BabyAI BossLevel (test)
72Success Rate
9
BabyAI SynthSeq (test)
0.642Success Rate
9
BabyAI GoToSeq (test)
77.2Success Rate
9
BabyAI Synthseq
0.361Average Episodic Reward
7
BabyAI Pickup
0.486Average Episodic Reward
7
BabyAI Goto
0.575Average Episodic Reward
7
BabyAI
0.343Average Pass Rate
7
BabyAI
32.1Average Pass Rate
7
BabyAI
33.4Average Pass Rate
7
BabyAI
0.606Average Pass Rate
7
BabyAI instruction set
46.65P@10
7
BabyAI Combined Skills 3
2,454Token Cost
6
BabyAI Combined Skills 2
2,528Token Cost
6
BabyAI Combined Skills 1
1,961Token Cost
6
BabyAI Unlock
5,705Token Cost
6
BabyAI Pickup
2,405Token Cost
6
BabyAI GoToRedBall
0.92Mean Episodic Return
5
BabyAI
93.2Success Rate
2