ManiSkill
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ManiSkill image-based 2-task Color Swapped (OOD)
70.7Pick Success Rate
5
ManiSkill image-based 2-task In Distribution
98Pick Score
5
ManiSkill Simulation 50-Shot
75Transfer Success Rate
5
ManiSkill Simulation 10-Shot
60.33Transfer Success Rate
5
ManiSkill Simulation 5-Shot
54.33Transfer Success Rate
5
ManiSkill Simulation 3-Shot
48.33Transfer Success Rate
5
ManiSkill Simulation 1-Shot
36Transfer Success Rate
5
ManiSkill3 v1 (test)
91Stack Cube Success Rate
4
ManiSkill3 (test)
91Stack Cube Success Rate
4
ManiSkill
58.7Liftpeg Success Rate
4
ManiSkill roll-out seeds (test)
90.94Binary Success
4
ManiSkill stack-cube 2
170Return
4
ManiSkill2 pick-cube
161Return
4
ManiSkill3 OOD (test)
94.53Success Rate (Table Texture)
4
ManiSkill zero-shot
41Pick Cube Success Rate
4
ManiSkill3 LiftPegUprightMO v1
0.65Average Reward
4
ManiSkill3 PickCubeMO-v1
0.33Average Reward
4
ManiSkill3 PullCubeToolMO v1
0.29Average Reward
4
ManiSkill
0.028Chamfer L1 Distance
3
ManiSkill
0.014Chamfer L1
3
ManiSkill
0.009Chamfer L1 Distance
3
ManiSkill (test)
62Success Rate
3
ManiSkill (test)
84Success Rate
3
ManiSkill (test)
89Success Rate
3
ManiSkill PushCube OOD v2
94.4Success Rate at t*
3