# Drawer Opening on SimplerEnv Google Robot embodiment (test) Source: [Drawer Opening on SimplerEnv Google Robot embodiment (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:05:07.127Z Evaluation of the success rate for the Drawer Opening task specifically within the SimplerEnv Google Robot embodiment test set. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Drawer Opening | | Dataset (including any stated split) | SimplerEnv Google Robot embodiment (test) | | Metric | Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | DUALVLA | 64 | Not recorded | 692d2109d6b0dd3342931627 | | DUALVLA | 63.9 | Not recorded | 692d2109d6b0dd3342931627 | | TraceVLA | 63.1 | Not recorded | 692d2109d6b0dd3342931627 | | OpenVLA | 63 | Not recorded | 692d2109d6b0dd3342931627 | | TraceVLA | 61.6 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-E | 60.6 | Not recorded | 692d2109d6b0dd3342931627 | | RT-1-X | 59.7 | Not recorded | 692d2109d6b0dd3342931627 | | SpatialVLA | 57.4 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-G | 55.2 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-G | 55 | Not recorded | 692d2109d6b0dd3342931627 | | ThinkACT | 50 | Not recorded | 692d2109d6b0dd3342931627 | | ThinkACT | 47.6 | Not recorded | 692d2109d6b0dd3342931627 | | InstructVLA-E | 47.2 | Not recorded | 692d2109d6b0dd3342931627 | | RoboVLMs | 43.5 | Not recorded | 692d2109d6b0dd3342931627 | | SpatialVLA | 41.8 | Not recorded | 692d2109d6b0dd3342931627 | | RT-2-X | 35.5 | Not recorded | 692d2109d6b0dd3342931627 | | RT-1-X | 29.4 | Not recorded | 692d2109d6b0dd3342931627 | | OpenVLA | 28.8 | Not recorded | 692d2109d6b0dd3342931627 | | RT-2-X | 25 | Not recorded | 692d2109d6b0dd3342931627 | | Octo-Base | 22.7 | Not recorded | 692d2109d6b0dd3342931627 | | Emma-X | 20.5 | Not recorded | 692d2109d6b0dd3342931627 | | Emma-X | 18.3 | Not recorded | 692d2109d6b0dd3342931627 | | RoboVLMs | 10.6 | Not recorded | 692d2109d6b0dd3342931627 | | Magma | 9.7 | Not recorded | 692d2109d6b0dd3342931627 | | Magma | 5.8 | Not recorded | 692d2109d6b0dd3342931627 | | Octo-Base | 1.1 | Not recorded | 692d2109d6b0dd3342931627 | | ECoT | 0 | Not recorded | 692d2109d6b0dd3342931627 | | ECoT | 0 | Not recorded | 692d2109d6b0dd3342931627 | ### DUALVLA Success Rate: 64. Result ID: 6995e6ff3badfaffe6ef2fca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### DUALVLA Success Rate: 63.9. Result ID: 6995e6ff3badfaffe6ef2fc9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### TraceVLA Success Rate: 63.1. Result ID: 6995e6ff3badfaffe6ef2fb7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### OpenVLA Success Rate: 63. Result ID: 6995e6ff3badfaffe6ef2fb9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### TraceVLA Success Rate: 61.6. Result ID: 6995e6ff3badfaffe6ef2fb8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### InstructVLA-E Success Rate: 60.6. Result ID: 6995e6ff3badfaffe6ef2fbe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RT-1-X Success Rate: 59.7. Result ID: 6995e6ff3badfaffe6ef2faf. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### SpatialVLA Success Rate: 57.4. Result ID: 6995e6ff3badfaffe6ef2fbb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### InstructVLA-G Success Rate: 55.2. Result ID: 6995e6ff3badfaffe6ef2fc8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### InstructVLA-G Success Rate: 55. Result ID: 6995e6ff3badfaffe6ef2fc7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### ThinkACT Success Rate: 50. Result ID: 6995e6ff3badfaffe6ef2fc5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### ThinkACT Success Rate: 47.6. Result ID: 6995e6ff3badfaffe6ef2fc6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### InstructVLA-E Success Rate: 47.2. Result ID: 6995e6ff3badfaffe6ef2fbd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### RoboVLMs Success Rate: 43.5. Result ID: 6995e6ff3badfaffe6ef2fb5. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### SpatialVLA Success Rate: 41.8. Result ID: 6995e6ff3badfaffe6ef2fbc. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RT-2-X Success Rate: 35.5. Result ID: 6995e6ff3badfaffe6ef2fb2. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RT-1-X Success Rate: 29.4. Result ID: 6995e6ff3badfaffe6ef2fb0. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### OpenVLA Success Rate: 28.8. Result ID: 6995e6ff3badfaffe6ef2fba. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### RT-2-X Success Rate: 25. Result ID: 6995e6ff3badfaffe6ef2fb1. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### Octo-Base Success Rate: 22.7. Result ID: 6995e6ff3badfaffe6ef2fb3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### Emma-X Success Rate: 20.5. Result ID: 6995e6ff3badfaffe6ef2fc4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### Emma-X Success Rate: 18.3. Result ID: 6995e6ff3badfaffe6ef2fc3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### RoboVLMs Success Rate: 10.6. Result ID: 6995e6ff3badfaffe6ef2fb6. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### Magma Success Rate: 9.7. Result ID: 6995e6ff3badfaffe6ef2fbf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### Magma Success Rate: 5.8. Result ID: 6995e6ff3badfaffe6ef2fc0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### Octo-Base Success Rate: 1.1. Result ID: 6995e6ff3badfaffe6ef2fb4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. ### ECoT Success Rate: 0. Result ID: 6995e6ff3badfaffe6ef2fc1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Visual Matching (VM)"}. This record does not assert independent reproduction. ### ECoT Success Rate: 0. Result ID: 6995e6ff3badfaffe6ef2fc2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Variance Aggregation (VA)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.