# Robot Manipulation (Grasp and Success Rates) on SimplerEnv WidowX

Source: [Robot Manipulation (Grasp and Success Rates) on SimplerEnv WidowX](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-11T09:10:21.572Z

Evaluation of robot manipulation performance on the SimplerEnv WidowX environment, reporting both Grasp success rates and final success rates for tasks involving placing a Spoon, Carrot, Stacking Blocks, and placing an Eggplant.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Robot Manipulation |
| Dataset (including any stated split) | SimplerEnv WidowX |
| Metric | Success Rate: Put Spoon |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 23 of 23 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Success Rate: Put Spoon](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Success%20Rate%3A%20Put%20Spoon>): Higher is better; unit: PERCENT.

- [Grasp Rate: Put Spoon](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Grasp%20Rate%3A%20Put%20Spoon>): Higher is better; unit: PERCENT.

- [Grasp Rate: Put Carrot](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Grasp%20Rate%3A%20Put%20Carrot>): Higher is better; unit: PERCENT.

- [Success Rate: Put Carrot](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Success%20Rate%3A%20Put%20Carrot>): Higher is better; unit: PERCENT.

- [Grasp Rate: Stack Blocks](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Grasp%20Rate%3A%20Stack%20Blocks>): Higher is better; unit: PERCENT.

- [Success Rate: Stack Blocks](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Success%20Rate%3A%20Stack%20Blocks>): Higher is better; unit: PERCENT.

- [Grasp Rate: Put Eggplant](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Grasp%20Rate%3A%20Put%20Eggplant>): Higher is better; unit: PERCENT.

- [Success Rate: Put Eggplant](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Success%20Rate%3A%20Put%20Eggplant>): Higher is better; unit: PERCENT.

- [Average Grasp Rate](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Average%20Grasp%20Rate>): Higher is better; unit: PERCENT.

- [Average Success Rate](<https://www.sota2.com/research/sota/robot-manipulation-grasp-and-success-rates-on-simplerenv-widowx.md?metric=Average%20Success%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Success Rate: Put Spoon | Result date | Report paper |
| --- | --- | --- | --- |
| LAST-Continuous | 62.5 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| LAST-Discretized | 58.3 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| Octo-Small | 47.2 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| Octo-Small | 47.2 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| RoboVLMs | 45.8 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| π0-FAST-Continuous | 45.8 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| BEAST | 41.7 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| BEAST-Continuous | 37.5 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| OpenVLA-OFT | 34.5 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| PixelVLA-π0 | 32.4 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| π0-FAST | 29.2 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| π0 | 29.1 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| π0 | 29.1 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| π0-SFT | 26.8 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| RoboVLMs | 20.8 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| SpatialVLA | 20.8 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| SpatialVLA | 16.7 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| Octo-Base | 12.5 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| Octo-Base | 12.5 | Not recorded | 6a2a40e5d33dfb23e7839144 |
| PixelVLA | 4.2 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| RT-1-X | 0 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| OpenVLA | 0 | Not recorded | 690988883ef7ccd74e5e5cd8 |
| OpenVLA-SFT | 0 | Not recorded | 690988883ef7ccd74e5e5cd8 |

### LAST-Continuous

Success Rate: Put Spoon: 62.5. Result ID: 6a2a7b78fbc373592c27d72b.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

Recorded evaluation configuration: {"Action Generation Mode":"Continuous"}. This record does not assert independent reproduction.

### LAST-Discretized

Success Rate: Put Spoon: 58.3. Result ID: 6a2a7b78fbc373592c27d72a.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

Recorded evaluation configuration: {"Action Generation Mode":"Discretized"}. This record does not assert independent reproduction.

### Octo-Small

Success Rate: Put Spoon: 47.2. Result ID: 69c285c747f34ce924aa84b4.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73551e209131cea5be6c.md>)

[Implementation](<https://octo-models.github.io/>)

Recorded evaluation configuration: {"Model Scale":"Small"}. This record does not assert independent reproduction.

### Octo-Small

Success Rate: Put Spoon: 47.2. Result ID: 6a2a7b78fbc373592c27d722.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73551e209131cea5be6c.md>)

[Implementation](<https://octo-models.github.io/>)

Recorded evaluation configuration: {"Model Scale":"Small"}. This record does not assert independent reproduction.

### RoboVLMs

Success Rate: Put Spoon: 45.8. Result ID: 6a2a7b78fbc373592c27d723.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76601e209131cea6cbc6.md>)

[Implementation](<https://www.sota2.com/robovlms.github.io>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### π0-FAST-Continuous

Success Rate: Put Spoon: 45.8. Result ID: 6a2a7b78fbc373592c27d727.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76951e209131cea6de09.md>)

Recorded evaluation configuration: {"Model Variant":"FAST","Action Generation Mode":"Continuous"}. This record does not assert independent reproduction.

### BEAST

Success Rate: Put Spoon: 41.7. Result ID: 6a2a7b78fbc373592c27d728.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa794f1e209131cea7d0e7.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BEAST-Continuous

Success Rate: Put Spoon: 37.5. Result ID: 6a2a7b78fbc373592c27d729.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa794f1e209131cea7d0e7.md>)

Recorded evaluation configuration: {"Action Generation Mode":"Continuous"}. This record does not assert independent reproduction.

### OpenVLA-OFT

Success Rate: Put Spoon: 34.5. Result ID: 6a2a7b78fbc373592c27d724.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78471e209131cea7794b.md>)

Recorded evaluation configuration: {"Model Variant":"OFT"}. This record does not assert independent reproduction.

### PixelVLA-π0

Success Rate: Put Spoon: 32.4. Result ID: 69c285c747f34ce924aa84bc.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

Recorded evaluation configuration: {"Base Architecture":"π0"}. This record does not assert independent reproduction.

### π0-FAST

Success Rate: Put Spoon: 29.2. Result ID: 6a2a7b78fbc373592c27d726.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76951e209131cea6de09.md>)

Recorded evaluation configuration: {"Model Variant":"FAST"}. This record does not assert independent reproduction.

### π0

Success Rate: Put Spoon: 29.1. Result ID: 69c285c747f34ce924aa84ba.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75aa1e209131cea6929a.md>)

Recorded evaluation configuration: {"Zero-shot Evaluation":"true"}. This record does not assert independent reproduction.

### π0

Success Rate: Put Spoon: 29.1. Result ID: 6a2a7b78fbc373592c27d721.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75aa1e209131cea6929a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### π0-SFT

Success Rate: Put Spoon: 26.8. Result ID: 69c285c747f34ce924aa84bb.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75aa1e209131cea6929a.md>)

Recorded evaluation configuration: {"Supervised Fine-Tuning (SFT)":"true"}. This record does not assert independent reproduction.

### RoboVLMs

Success Rate: Put Spoon: 20.8. Result ID: 69c285c747f34ce924aa84b5.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76601e209131cea6cbc6.md>)

[Implementation](<https://www.sota2.com/robovlms.github.io>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SpatialVLA

Success Rate: Put Spoon: 20.8. Result ID: 69c285c747f34ce924aa84b6.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78951e209131cea79169.md>)

[Implementation](<https://spatialvla.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SpatialVLA

Success Rate: Put Spoon: 16.7. Result ID: 6a2a7b78fbc373592c27d725.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78951e209131cea79169.md>)

[Implementation](<https://spatialvla.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Octo-Base

Success Rate: Put Spoon: 12.5. Result ID: 69c285c747f34ce924aa84b3.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73551e209131cea5be6c.md>)

[Implementation](<https://octo-models.github.io/>)

Recorded evaluation configuration: {"Model Scale":"Base"}. This record does not assert independent reproduction.

### Octo-Base

Success Rate: Put Spoon: 12.5. Result ID: 6a2a7b78fbc373592c27d720.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40e5d33dfb23e7839144.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73551e209131cea5be6c.md>)

[Implementation](<https://octo-models.github.io/>)

Recorded evaluation configuration: {"Model Scale":"Base"}. This record does not assert independent reproduction.

### PixelVLA

Success Rate: Put Spoon: 4.2. Result ID: 69c285c747f34ce924aa84b9.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

Recorded evaluation configuration: {"Base Architecture":"OpenVLA"}. This record does not assert independent reproduction.

### RT-1-X

Success Rate: Put Spoon: 0. Result ID: 69c285c747f34ce924aa84b2.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OpenVLA

Success Rate: Put Spoon: 0. Result ID: 69c285c747f34ce924aa84b7.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74c31e209131cea63a36.md>)

[Implementation](<https://openvla.github.io/>)

Recorded evaluation configuration: {"Zero-shot Evaluation":"true"}. This record does not assert independent reproduction.

### OpenVLA-SFT

Success Rate: Put Spoon: 0. Result ID: 69c285c747f34ce924aa84b8.

[Reporting paper](<https://www.sota2.com/research/paper/690988883ef7ccd74e5e5cd8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74c31e209131cea63a36.md>)

[Implementation](<https://openvla.github.io/>)

Recorded evaluation configuration: {"Supervised Fine-Tuning (SFT)":"true"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
