# Embodied Planning & Correction on RoboFAC

Source: [Embodied Planning & Correction on RoboFAC](<https://www.sota2.com/research/sota/embodied-planning-and-correction-on-robofac>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-11T09:26:03.651Z

Evaluation of model performance on the RoboFAC dataset for the task of Embodied Planning and Correction, typically measured using Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Embodied Planning & Correction |
| Dataset (including any stated split) | RoboFAC |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/embodied-planning-and-correction-on-robofac.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Embodied-R1.5 | 77.2 | Not recorded | 6a2a40eed33dfb23e78391ab |
| GPT-5.4 | 70.1 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Qwen3-VL-8B | 65.4 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Pelican-VL-1.0 | 60.2 | Not recorded | 6a2a40eed33dfb23e78391ab |
| VeBrain | 58.8 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Mimo-Embodied | 54.6 | Not recorded | 6a2a40eed33dfb23e78391ab |
| RoboBrain-2.0-7B | 54.2 | Not recorded | 6a2a40eed33dfb23e78391ab |
| GPT-4o | 48.9 | Not recorded | 6a2a40eed33dfb23e78391ab |
| InternVL3.5-8B | 48.6 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Gemini-Robotics-ER-1.5 | 47 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Gemini-2.5-Pro | 46.4 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Embodied-R1 | 40.2 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Magma | 18.1 | Not recorded | 6a2a40eed33dfb23e78391ab |
| Molmo-D-7B | 11.5 | Not recorded | 6a2a40eed33dfb23e78391ab |

### Embodied-R1.5

Accuracy: 77.2. Result ID: 6a2a7e8afbc373592c27ed36.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Implementation](<https://github.com/pickxiguapi/Embodied-R1.5>)

Recorded evaluation configuration: {"Model Type":"Ours"}. This record does not assert independent reproduction.

### GPT-5.4

Accuracy: 70.1. Result ID: 6a2a7e8afbc373592c27ed2a.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

Recorded evaluation configuration: {"Model Type":"General-Purpose VLM"}. This record does not assert independent reproduction.

### Qwen3-VL-8B

Accuracy: 65.4. Result ID: 6a2a7e8afbc373592c27ed2c.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

Recorded evaluation configuration: {"Model Type":"General-Purpose VLM"}. This record does not assert independent reproduction.

### Pelican-VL-1.0

Accuracy: 60.2. Result ID: 6a2a7e8afbc373592c27ed33.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/690988753ef7ccd74e5e5a1d.md>)

Recorded evaluation configuration: {"Model Type":"Embodied VLM"}. This record does not assert independent reproduction.

### VeBrain

Accuracy: 58.8. Result ID: 6a2a7e8afbc373592c27ed31.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78fa1e209131cea7b711.md>)

Recorded evaluation configuration: {"Model Type":"Embodied VLM"}. This record does not assert independent reproduction.

### Mimo-Embodied

Accuracy: 54.6. Result ID: 6a2a7e8afbc373592c27ed32.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691ff204d6b0dd334292e641.md>)

[Implementation](<https://github.com/XiaomiMiMo/MiMo-Embodied>)

Recorded evaluation configuration: {"Model Type":"Embodied VLM"}. This record does not assert independent reproduction.

### RoboBrain-2.0-7B

Accuracy: 54.2. Result ID: 6a2a7e8afbc373592c27ed30.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77931e209131cea74136.md>)

Recorded evaluation configuration: {"Model Type":"Embodied VLM"}. This record does not assert independent reproduction.

### GPT-4o

Accuracy: 48.9. Result ID: 6a2a7e8afbc373592c27ed29.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

Recorded evaluation configuration: {"Model Type":"General-Purpose VLM"}. This record does not assert independent reproduction.

### InternVL3.5-8B

Accuracy: 48.6. Result ID: 6a2a7e8afbc373592c27ed2d.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: {"Model Type":"General-Purpose VLM"}. This record does not assert independent reproduction.

### Gemini-Robotics-ER-1.5

Accuracy: 47. Result ID: 6a2a7e8afbc373592c27ed2f.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77a21e209131cea747ed.md>)

Recorded evaluation configuration: {"Model Type":"Embodied VLM"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro

Accuracy: 46.4. Result ID: 6a2a7e8afbc373592c27ed2b.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

Recorded evaluation configuration: {"Model Type":"General-Purpose VLM"}. This record does not assert independent reproduction.

### Embodied-R1

Accuracy: 40.2. Result ID: 6a2a7e8afbc373592c27ed35.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

Recorded evaluation configuration: {"Model Type":"Embodied VLM"}. This record does not assert independent reproduction.

### Magma

Accuracy: 18.1. Result ID: 6a2a7e8afbc373592c27ed34.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770b1e209131cea70b91.md>)

[Implementation](<https://microsoft.github.io/Magma>)

Recorded evaluation configuration: {"Model Type":"Embodied VLM"}. This record does not assert independent reproduction.

### Molmo-D-7B

Accuracy: 11.5. Result ID: 6a2a7e8afbc373592c27ed2e.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a40eed33dfb23e78391ab.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76101e209131cea6b37c.md>)

[Implementation](<https://molmo.allenai.org/>)

Recorded evaluation configuration: {"Model Type":"General-Purpose VLM"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
