# Language-conditioned visuomotor control on CALVIN ABC-\>D (Zero-shot)

Source: [Language-conditioned visuomotor control on CALVIN ABC-\>D (Zero-shot)](<https://www.sota2.com/research/sota/language-conditioned-visuomotor-control-on-calvin-abc-d-zero-shot>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:39:39.120Z

Evaluation of language-conditioned visuomotor control performance on the CALVIN ABC-\>D dataset under zero-shot evaluation conditions, measuring sequential task completion rates and average trajectory length.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Language-conditioned visuomotor control |
| Dataset (including any stated split) | CALVIN ABC→D (Zero-shot) |
| Metric | Completion Rate (Seq 1) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Completion Rate (Seq 1)](<https://www.sota2.com/research/sota/language-conditioned-visuomotor-control-on-calvin-abc-d-zero-shot.md?metric=Completion%20Rate%20(Seq%201)>): Higher is better; unit: PERCENT.

- [Completion Rate (Seq 2)](<https://www.sota2.com/research/sota/language-conditioned-visuomotor-control-on-calvin-abc-d-zero-shot.md?metric=Completion%20Rate%20(Seq%202)>): Higher is better; unit: PERCENT.

- [Completion Rate (Seq 3)](<https://www.sota2.com/research/sota/language-conditioned-visuomotor-control-on-calvin-abc-d-zero-shot.md?metric=Completion%20Rate%20(Seq%203)>): Higher is better; unit: PERCENT.

- [Completion Rate (Seq 4)](<https://www.sota2.com/research/sota/language-conditioned-visuomotor-control-on-calvin-abc-d-zero-shot.md?metric=Completion%20Rate%20(Seq%204)>): Higher is better; unit: PERCENT.

- [Completion Rate (Seq 5)](<https://www.sota2.com/research/sota/language-conditioned-visuomotor-control-on-calvin-abc-d-zero-shot.md?metric=Completion%20Rate%20(Seq%205)>): Higher is better; unit: PERCENT.

- [Avg Trajectory Length](<https://www.sota2.com/research/sota/language-conditioned-visuomotor-control-on-calvin-abc-d-zero-shot.md?metric=Avg%20Trajectory%20Length>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Completion Rate (Seq 1) | Result date | Report paper |
| --- | --- | --- | --- |
| CLOVER | 96 | Not recorded | 68fa78851e209131cea78d36 |
| UniVLA | 95.5 | Not recorded | 68fa78851e209131cea78d36 |
| RoboDual | 94.4 | Not recorded | 68fa78851e209131cea78d36 |
| OpenVLA | 91.3 | Not recorded | 68fa78851e209131cea78d36 |
| SuSIE | 87 | Not recorded | 68fa78851e209131cea78d36 |
| GR-1 | 85.4 | Not recorded | 68fa78851e209131cea78d36 |
| RoboFlamingo | 82.4 | Not recorded | 68fa78851e209131cea78d36 |
| RT-1 | 53.3 | Not recorded | 68fa78851e209131cea78d36 |

### CLOVER

Completion Rate (Seq 1): 96. Result ID: 699590443badfaffe68a52b6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa753e1e209131cea66ba3.md>)

[Implementation](<https://github.com/OpenDriveLab/CLOVER>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### UniVLA

Completion Rate (Seq 1): 95.5. Result ID: 699590443badfaffe68a52b8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Implementation](<https://github.com/OpenDriveLab/UniVLA>)

Recorded evaluation configuration: {"Inputs":"Third-view RGB only"}. This record does not assert independent reproduction.

### RoboDual

Completion Rate (Seq 1): 94.4. Result ID: 699590443badfaffe68a52b7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76e91e209131cea6fe1c.md>)

[Implementation](<https://opendrivelab.com/RoboDual/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OpenVLA

Completion Rate (Seq 1): 91.3. Result ID: 699590443badfaffe68a52b5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74c31e209131cea63a36.md>)

[Implementation](<https://openvla.github.io/>)

Recorded evaluation configuration: {"Reproduced with action chunks prediction":true}. This record does not assert independent reproduction.

### SuSIE

Completion Rate (Seq 1): 87. Result ID: 699590443badfaffe68a52b3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ec1e209131cea4e08c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GR-1

Completion Rate (Seq 1): 85.4. Result ID: 699590443badfaffe68a52b4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71861e209131cea51c7f.md>)

[Implementation](<https://gr1-manipulation.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RoboFlamingo

Completion Rate (Seq 1): 82.4. Result ID: 699590443badfaffe68a52b2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa721c1e209131cea548b5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RT-1

Completion Rate (Seq 1): 53.3. Result ID: 699590443badfaffe68a52b1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78851e209131cea78d36.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f7d.md>)

[Implementation](<http://github.com/google-research/robotics_transformer>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.