# Contact-rich manipulation on Consolidated real-world manipulation dataset (eval)

Source: [Contact-rich manipulation on Consolidated real-world manipulation dataset (eval)](<https://www.sota2.com/research/sota/contact-rich-manipulation-on-consolidated-real-world-manipulation-dataset-eval>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-28T07:50:27.471Z

Evaluation of contact-rich manipulation performance on the Consolidated real-world manipulation dataset (eval split), focusing on success rates for specific primitives including Unstack Cup, Plug Insertion, Egg Pick & Place, and Board Erase.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Contact-rich manipulation |
| Dataset (including any stated split) | Consolidated real-world manipulation dataset (eval) |
| Metric | Unstack Cup Success Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Unstack Cup Success Rate](<https://www.sota2.com/research/sota/contact-rich-manipulation-on-consolidated-real-world-manipulation-dataset-eval.md?metric=Unstack%20Cup%20Success%20Rate>): Higher is better; unit: PERCENT.

- [Egg PnP Success Rate](<https://www.sota2.com/research/sota/contact-rich-manipulation-on-consolidated-real-world-manipulation-dataset-eval.md?metric=Egg%20PnP%20Success%20Rate>): Higher is better; unit: PERCENT.

- [Board Erase Success Rate](<https://www.sota2.com/research/sota/contact-rich-manipulation-on-consolidated-real-world-manipulation-dataset-eval.md?metric=Board%20Erase%20Success%20Rate>): Higher is better; unit: PERCENT.

- [Plug Insertion Success Rate](<https://www.sota2.com/research/sota/contact-rich-manipulation-on-consolidated-real-world-manipulation-dataset-eval.md?metric=Plug%20Insertion%20Success%20Rate>): Higher is better; unit: PERCENT.

- [Average Success Rate](<https://www.sota2.com/research/sota/contact-rich-manipulation-on-consolidated-real-world-manipulation-dataset-eval.md?metric=Average%20Success%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Unstack Cup Success Rate | Result date | Report paper |
| --- | --- | --- | --- |
| GR00T N1.5 + MoSS | 54.2 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| GR00T N1.5 + MoSS | 45.8 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| GR00T N1.5 + ForceVLA | 37.5 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| GR00T N1.5 + MoSS | 33.3 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| GR00T N1.5 + Tactile-VLA | 29.2 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| GR00T N1.5 + TA-VLA | 29.2 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| π0 + MoSS | 29.2 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| π0 + MoSS | 29.2 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| π0 + ForceVLA | 25 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| π0 + MoSS | 20.8 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| GR00T N1.5 | 16.7 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| π0 + Tactile-VLA | 16.7 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| π0 + TA-VLA | 16.7 | Not recorded | 69f03ee855a3c32af89f9ed6 |
| π0 | 12.5 | Not recorded | 69f03ee855a3c32af89f9ed6 |

### GR00T N1.5 + MoSS

Unstack Cup Success Rate: 54.2. Result ID: 69f0657647f34ce924d6007f.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"true"}. This record does not assert independent reproduction.

### GR00T N1.5 + MoSS

Unstack Cup Success Rate: 45.8. Result ID: 69f0657647f34ce924d6007c.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"false"}. This record does not assert independent reproduction.

### GR00T N1.5 + ForceVLA

Unstack Cup Success Rate: 37.5. Result ID: 69f0657647f34ce924d6007b.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b5f1e209131cea87fd3.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"false"}. This record does not assert independent reproduction.

### GR00T N1.5 + MoSS

Unstack Cup Success Rate: 33.3. Result ID: 69f0657647f34ce924d6007e.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

Recorded evaluation configuration: {"Tactile":"false","Torque":"true"}. This record does not assert independent reproduction.

### GR00T N1.5 + Tactile-VLA

Unstack Cup Success Rate: 29.2. Result ID: 69f0657647f34ce924d6007a.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79f61e209131cea8047f.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"false"}. This record does not assert independent reproduction.

### GR00T N1.5 + TA-VLA

Unstack Cup Success Rate: 29.2. Result ID: 69f0657647f34ce924d6007d.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b2c1e209131cea87064.md>)

Recorded evaluation configuration: {"Tactile":"false","Torque":"true"}. This record does not assert independent reproduction.

### π0 + MoSS

Unstack Cup Success Rate: 29.2. Result ID: 69f0657647f34ce924d60083.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"false"}. This record does not assert independent reproduction.

### π0 + MoSS

Unstack Cup Success Rate: 29.2. Result ID: 69f0657647f34ce924d60086.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"true"}. This record does not assert independent reproduction.

### π0 + ForceVLA

Unstack Cup Success Rate: 25. Result ID: 69f0657647f34ce924d60082.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b5f1e209131cea87fd3.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"false"}. This record does not assert independent reproduction.

### π0 + MoSS

Unstack Cup Success Rate: 20.8. Result ID: 69f0657647f34ce924d60085.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

Recorded evaluation configuration: {"Tactile":"false","Torque":"true"}. This record does not assert independent reproduction.

### GR00T N1.5

Unstack Cup Success Rate: 16.7. Result ID: 69f0657647f34ce924d60079.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

Recorded evaluation configuration: {"Tactile":"false","Torque":"false"}. This record does not assert independent reproduction.

### π0 + Tactile-VLA

Unstack Cup Success Rate: 16.7. Result ID: 69f0657647f34ce924d60081.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79f61e209131cea8047f.md>)

Recorded evaluation configuration: {"Tactile":"true","Torque":"false"}. This record does not assert independent reproduction.

### π0 + TA-VLA

Unstack Cup Success Rate: 16.7. Result ID: 69f0657647f34ce924d60084.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b2c1e209131cea87064.md>)

Recorded evaluation configuration: {"Tactile":"false","Torque":"true"}. This record does not assert independent reproduction.

### π0

Unstack Cup Success Rate: 12.5. Result ID: 69f0657647f34ce924d60080.

[Reporting paper](<https://www.sota2.com/research/paper/69f03ee855a3c32af89f9ed6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75aa1e209131cea6929a.md>)

Recorded evaluation configuration: {"Tactile":"false","Torque":"false"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
