Open/Close Drawer on SimplerEnv Google Robot Variant Aggregation (test)
0.56Success RateRT1-X
Evaluation results
| Method | Links | |
|---|---|---|
| RT1-X2024.12 | 0.56 | |
| TraceVLAModel Size=7B2024.12 | 0.31 | |
| TraceVLA-Phi3Model Size=4B2024.12 | 0.232 | |
| OpenVLAModel Size=7B2024.12 | 0.225 | |
| OpenVLA-Phi3Model Size=4B2024.12 | 0.222 | |
| Octo-Base2024.12 | 0.22 |