Pick Coke Can on SimplerEnv Google Robot (Variant Aggregation) (test)
60Success RateTraceVLA
Evaluation results
| Method | Links | |
|---|---|---|
| TraceVLAModel Size=7B2024.12 | 60 | |
| RT1-X2024.12 | 54 | |
| OpenVLAModel Size=7B2024.12 | 52.8 | |
| TraceVLA-Phi3Model Size=4B2024.12 | 52.4 | |
| OpenVLA-Phi3Model Size=4B2024.12 | 49.7 | |
| Octo-Base2024.12 | 17 |