Minecraft
Benchmarks
TaskDatasetSOTA resultTrendResults
Minecraft Long-horizon Tasks
100Wood
15
Minecraft
57.5CraftGrid Success@0→10
11
Minecraft
40WeaponSet Success@0→10
11
Minecraft
50BridgeEq Success@0→10
11
Minecraft
62.5Bed Success Rate (0->10 steps)
11
Minecraft long-horizon task suite (held-out)
69.7Success Rate
9
Minecraft MCU
68.4ASR
9
Minecraft 384 x 384
83Map Coverage
8
Minecraft 128 x 128
97Map Coverage
8
Minecraft Armor Group
55.6Success Rate (SR)
8
Minecraft Redstone Group
49.4Success Rate (SR)
8
Minecraft Diamond Group
66.1Success Rate (SR)
8
Minecraft Gold Group
72.3Success Rate (SR)
8
Minecraft Iron Group
74Success Rate (SR)
8
Minecraft Stone Group
80Success Rate (SR)
8
Minecraft Wood Group
95.7Success Rate (SR)
8
Minecraft Obtain Diamond task
100Log Success Rate
8
Minecraft
62.43FVD
8
Minecraft Overall
30.29Success Rate
7
Minecraft Diamond
17.36Success Rate (SR)
7
Minecraft Gold
21.69Success Rate (SR)
7
Minecraft Iron
51.82Success Rate (SR)
7
Minecraft Stone
94.53Success Rate (SR)
7
Minecraft Wood
97.47Success Rate (SR)
7
Minecraft (test)
61.1Single Performance Score
6