IsaacSim
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
IsaacSim (Ihlen) unseen objects (test)
0Collision Rate
12
IsaacSim Beechwood unseen objects (test)
720Completion Rate
12
IsaacSim Chemistry unseen objects (test)
4.4Completion Rate (CR)
12
IsaacSim Peg Insertion adapted from Nvidia Factory (test)
86Success Rate
8
IsaacSim Gear Meshing adapted from Nvidia Factory (test)
86Success Rate
8
IsaacSim Nut Threading adapted from Nvidia Factory (test)
100Success Rate
8
IsaacSim
171.1Area
6
IsaacSim
80.4Success Rate (SR)
6
IsaacSim
50.2Success Rate (SR)
6
IsaacSim
3Success Rate
6
IsaacSim
6Success Rate
6
IsaacSim
9Success Rate
6
IsaacSim
50Success Rate
6
IsaacSim
80Success Rate
6
IsaacSim
60Success Rate
6
IsaacSim
7Success Rate
6
IsaacSim
90Success Rate
6
IsaacSim benchmark
100Run Success Rate
4
IsaacSim Ihlen (unseen)
0.139FCR
4
IsaacSim Beechwood (unseen)
39.2Failure Case Rate (FCR)
4
IsaacSim Chemistry (unseen)
34.3FCR
4