Open/Close Drawer on SimplerEnv Google Robot Visual Matching (test)
57Success RateTraceVLA
Evaluation results
| Method | Links | |
|---|---|---|
| TraceVLAModel Size=7B2024.12 | 57 | |
| OpenVLAModel Size=7B2024.12 | 49.5 | |
| TraceVLA-Phi3Model Size=4B2024.12 | 31 | |
| OpenVLA-Phi3Model Size=4B2024.12 | 22.5 | |
| RT1-X2024.12 | 22.5 | |
| Octo-Base2024.12 | 1 |