# Pick Can on SimplerEnv Google Robot embodiment Source: [Pick Can on SimplerEnv Google Robot embodiment]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:05:07.145Z Evaluation of the success rate for the 'Pick Can' task using the embodiment configuration of the SimplerEnv Google Robot environment. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Pick Can | | Dataset (including any stated split) | SimplerEnv Google Robot embodiment | | Metric | Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | DUALVLA | 93.3 | Not recorded | 692d2109d6b0dd3342931627 | | ThinkACT | 92 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-G | 90.8 | Not recorded | 692d2109d6b0dd3342931627 | | SpatialVLA | 88 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-E | 87.7 | Not recorded | 692d2109d6b0dd3342931627 | | SpatialVLA | 86 | Not recorded | 692d2109d6b0dd3342931627 | | ThinkACT | 84 | Not recorded | 692d2109d6b0dd3342931627 | | DUALVLA | 82.7 | Not recorded | 692d2109d6b0dd3342931627 | | RT-2-X | 82.3 | Not recorded | 692d2109d6b0dd3342931627 | | RT-2-X | 78.7 | Not recorded | 692d2109d6b0dd3342931627 | | RoboVLMs | 77.3 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-G | 77.2 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-E | 76 | Not recorded | 692d2109d6b0dd3342931627 | | RoboVLMs | 75.6 | Not recorded | 692d2109d6b0dd3342931627 | | TraceVLA | 64.3 | Not recorded | 692d2109d6b0dd3342931627 | | OpenVLA | 60.8 | Not recorded | 692d2109d6b0dd3342931627 | | RT-1-X | 56.7 | Not recorded | 692d2109d6b0dd3342931627 | | RT-1-X | 49 | Not recorded | 692d2109d6b0dd3342931627 | | Magma | 46.4 | Not recorded | 692d2109d6b0dd3342931627 | | Magma | 46 | Not recorded | 692d2109d6b0dd3342931627 | | TraceVLA | 45 | Not recorded | 692d2109d6b0dd3342931627 | | OpenVLA | 18 | Not recorded | 692d2109d6b0dd3342931627 | | Octo-Base | 17 | Not recorded | 692d2109d6b0dd3342931627 | | Emma-X | 5.3 | Not recorded | 692d2109d6b0dd3342931627 | | Emma-X | 2.3 | Not recorded | 692d2109d6b0dd3342931627 | | Octo-Base | 0.6 | Not recorded | 692d2109d6b0dd3342931627 | | ECoT | 0 | Not recorded | 692d2109d6b0dd3342931627 | | ECoT | 0 | Not recorded | 692d2109d6b0dd3342931627 | ### DUALVLA Success Rate: 93.3. Result ID: 6995e6ff3badfaffe6ef2fe5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### ThinkACT Success Rate: 92. Result ID: 6995e6ff3badfaffe6ef2fe1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### InstructVLA-G Success Rate: 90.8. Result ID: 6995e6ff3badfaffe6ef2fe4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### SpatialVLA Success Rate: 88. Result ID: 6995e6ff3badfaffe6ef2fd8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### InstructVLA-E Success Rate: 87.7. Result ID: 6995e6ff3badfaffe6ef2fd9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### SpatialVLA Success Rate: 86. Result ID: 6995e6ff3badfaffe6ef2fd7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### ThinkACT Success Rate: 84. Result ID: 6995e6ff3badfaffe6ef2fe2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### DUALVLA Success Rate: 82.7. Result ID: 6995e6ff3badfaffe6ef2fe6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RT-2-X Success Rate: 82.3. Result ID: 6995e6ff3badfaffe6ef2fce. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RT-2-X Success Rate: 78.7. Result ID: 6995e6ff3badfaffe6ef2fcd. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### RoboVLMs Success Rate: 77.3. Result ID: 6995e6ff3badfaffe6ef2fd1. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### InstructVLA-G Success Rate: 77.2. Result ID: 6995e6ff3badfaffe6ef2fe3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### InstructVLA-E Success Rate: 76. Result ID: 6995e6ff3badfaffe6ef2fda. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RoboVLMs Success Rate: 75.6. Result ID: 6995e6ff3badfaffe6ef2fd2. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### TraceVLA Success Rate: 64.3. Result ID: 6995e6ff3badfaffe6ef2fd4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### OpenVLA Success Rate: 60.8. Result ID: 6995e6ff3badfaffe6ef2fd6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RT-1-X Success Rate: 56.7. Result ID: 6995e6ff3badfaffe6ef2fcb. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### RT-1-X Success Rate: 49. Result ID: 6995e6ff3badfaffe6ef2fcc. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### Magma Success Rate: 46.4. Result ID: 6995e6ff3badfaffe6ef2fdc. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### Magma Success Rate: 46. Result ID: 6995e6ff3badfaffe6ef2fdb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### TraceVLA Success Rate: 45. Result ID: 6995e6ff3badfaffe6ef2fd3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### OpenVLA Success Rate: 18. Result ID: 6995e6ff3badfaffe6ef2fd5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### Octo-Base Success Rate: 17. Result ID: 6995e6ff3badfaffe6ef2fcf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### Emma-X Success Rate: 5.3. Result ID: 6995e6ff3badfaffe6ef2fe0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### Emma-X Success Rate: 2.3. Result ID: 6995e6ff3badfaffe6ef2fdf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### Octo-Base Success Rate: 0.6. Result ID: 6995e6ff3badfaffe6ef2fd0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### ECoT Success Rate: 0. Result ID: 6995e6ff3badfaffe6ef2fdd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### ECoT Success Rate: 0. Result ID: 6995e6ff3badfaffe6ef2fde. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.