MiniGrid
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MiniGrid
0.27Mean Return
5
MiniGrid
0.43Mean Return
5
MiniGrid DK-8
0.24Reward
5
MiniGrid 10% 5x5 (val)
85.55Hit Rate @ 1 (H@1)
4
MiniGrid RedBlueDoor (unseen seeds)
95.6Success Rate
4
MiniGrid LavaCrossing (unseen seeds)
93.1Success Rate
4
MiniGrid DoorKey (unseen seeds)
97Success Rate
4
MiniGrid 3 uncertain objects
1,000Success Rate
4
MiniGrid DoorKey-8x8 (100 episodes)
89Success Rate
3
MiniGrid DoorKey-16x16 v0 (unseen)
1Mean Return
3
MiniGrid-MultiRoom-N6 v0 (unseen)
1Mean Return
3
MiniGrid Wi-Fi-D
74Success Rate
3
MiniGrid Wi-Fi-N
81Success Rate
3
MiniGrid Real-Eth
85Success Rate
3
MiniGrid Sim+Net
87Success Rate
3
MiniGrid Sim-Clean
94Success Rate
3
MiniGrid 16x16
0.93Clean Reward
3
MiniGrid 8x8
93Clean Reward
3
MiniGrid 5 uncertain objects
99Success Rate
3
MiniGrid 1 uncertain object
100Success Rate
3
MiniGrid No uncertainty
100Success Rate
3
MiniGrid 16x16 (RGB image input) (test)
0.44Clean Reward
2
MiniGrid 8x8 RGB image input (test)
0.43Clean Reward
2
MiniGrid 16x16 (Coordinates) (test)
0.95Average Performance
2
MiniGrid 8x8 Coordinates (test)
0.91Average Reward
2