# Long-Horizon Multi-Task Language Control on CALVIN ABC→D (test) Source: [Long-Horizon Multi-Task Language Control on CALVIN ABC→D (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:04:17.501Z Evaluation of model performance on the CALVIN ABC→D test set for long-horizon, multi-task language control. Performance is measured by sequential success rates (completing 1 through 5 tasks in a row) and the average length of successful sequences. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Long-Horizon Multi-Task Language Control | | Dataset (including any stated split) | CALVIN ABC→D (test) | | Metric | Seq Success (1) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 13 of 13 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Seq Success (1)](): Higher is better; unit: PERCENT. - [Seq Success (2)](): Higher is better; unit: PERCENT. - [Seq Success (3)](): Higher is better; unit: PERCENT. - [Seq Success (4)](): Higher is better; unit: PERCENT. - [Seq Success (5)](): Higher is better; unit: PERCENT. - [Avg Sequence Length](): Higher is better; unit: SCALAR. ## Recorded results | Method | Seq Success (1) | Result date | Report paper | | --- | --- | --- | --- | | CLOVER | 96 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | ReconVLA | 95.6 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | UniVLA | 95.5 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | VISTA-OFT | 94.8 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | DITA | 94.5 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | RoboDual | 94.4 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | VISTA | 93.5 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | RoboVLMs | 93.1 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | OpenVLA | 92.8 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | OpenVLA-OFT | 92.1 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | VPP | 90.9 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | SuSIE | 87 | Not recorded | 69857565c97a0b3e3b5d5ae6 | | GR-1 | 85.4 | Not recorded | 69857565c97a0b3e3b5d5ae6 | ### CLOVER Seq Success (1): 96. Result ID: 699742155698665ec492e450. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ReconVLA Seq Success (1): 95.6. Result ID: 699742155698665ec492e454. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### UniVLA Seq Success (1): 95.5. Result ID: 699742155698665ec492e453. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VISTA-OFT Seq Success (1): 94.8. Result ID: 699742155698665ec492e458. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DITA Seq Success (1): 94.5. Result ID: 699742155698665ec492e44f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RoboDual Seq Success (1): 94.4. Result ID: 699742155698665ec492e451. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VISTA Seq Success (1): 93.5. Result ID: 699742155698665ec492e456. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RoboVLMs Seq Success (1): 93.1. Result ID: 699742155698665ec492e452. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"View":"Single static third-person view"}. This record does not assert independent reproduction. ### OpenVLA Seq Success (1): 92.8. Result ID: 699742155698665ec492e455. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"reproduced":true}. This record does not assert independent reproduction. ### OpenVLA-OFT Seq Success (1): 92.1. Result ID: 699742155698665ec492e457. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"reproduced":true}. This record does not assert independent reproduction. ### VPP Seq Success (1): 90.9. Result ID: 699742155698665ec492e44e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"View":"Single static third-person view"}. This record does not assert independent reproduction. ### SuSIE Seq Success (1): 87. Result ID: 699742155698665ec492e44c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GR-1 Seq Success (1): 85.4. Result ID: 699742155698665ec492e44d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.