# Put Carrot on SimplerEnv WidowX Robot embodiment Source: [Put Carrot on SimplerEnv WidowX Robot embodiment]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:05:07.190Z Evaluation of the success rate for the specific robotic manipulation task of placing a carrot using the WidowX embodiment within the SimplerEnv simulation environment. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Put Carrot | | Dataset (including any stated split) | SimplerEnv WidowX Robot embodiment | | Metric | Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 13 of 13 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | DUALVLA | 50 | Not recorded | 692d2109d6b0dd3342931627 | | ThinkACT | 37.5 | Not recorded | 692d2109d6b0dd3342931627 | | Magma | 33.3 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-G | 29.2 | Not recorded | 692d2109d6b0dd3342931627 | | SpatialVLA | 25 | Not recorded | 692d2109d6b0dd3342931627 | | RoboVLMs | 20.8 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-E | 20.8 | Not recorded | 692d2109d6b0dd3342931627 | | TraceVLA | 16.6 | Not recorded | 692d2109d6b0dd3342931627 | | Octo-Base | 12.5 | Not recorded | 692d2109d6b0dd3342931627 | | RT-1-X | 4.2 | Not recorded | 692d2109d6b0dd3342931627 | | ECoT | 4.2 | Not recorded | 692d2109d6b0dd3342931627 | | OpenVLA | 0 | Not recorded | 692d2109d6b0dd3342931627 | | Emma-X | 0 | Not recorded | 692d2109d6b0dd3342931627 | ### DUALVLA Success Rate: 50. Result ID: 6995e6ff3badfaffe6ef301c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ThinkACT Success Rate: 37.5. Result ID: 6995e6ff3badfaffe6ef301a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Magma Success Rate: 33.3. Result ID: 6995e6ff3badfaffe6ef3017. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### InstructVLA-G Success Rate: 29.2. Result ID: 6995e6ff3badfaffe6ef301b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SpatialVLA Success Rate: 25. Result ID: 6995e6ff3badfaffe6ef3015. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RoboVLMs Success Rate: 20.8. Result ID: 6995e6ff3badfaffe6ef3012. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### InstructVLA-E Success Rate: 20.8. Result ID: 6995e6ff3badfaffe6ef3016. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TraceVLA Success Rate: 16.6. Result ID: 6995e6ff3badfaffe6ef3013. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Octo-Base Success Rate: 12.5. Result ID: 6995e6ff3badfaffe6ef3011. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RT-1-X Success Rate: 4.2. Result ID: 6995e6ff3badfaffe6ef3010. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ECoT Success Rate: 4.2. Result ID: 6995e6ff3badfaffe6ef3018. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### OpenVLA Success Rate: 0. Result ID: 6995e6ff3badfaffe6ef3014. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Emma-X Success Rate: 0. Result ID: 6995e6ff3badfaffe6ef3019. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.