# Interactive Planning on ALFRED unseen (val)

Source: [Interactive Planning on ALFRED unseen (val)](<https://www.sota2.com/research/sota/interactive-planning-on-alfred-unseen-val>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:05:39.532Z

Evaluation of model performance on Interactive Planning tasks using the validation split of the ALFRED unseen set, measured by Success Rate (SR), Goal Completion (GC), and HLP.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Interactive Planning |
| Dataset (including any stated split) | ALFRED unseen (val) |
| Metric | Success Rate (SR) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Success Rate (SR)](<https://www.sota2.com/research/sota/interactive-planning-on-alfred-unseen-val.md?metric=Success%20Rate%20(SR)>): Higher is better; unit: PERCENT.

- [Goal Completion (GC)](<https://www.sota2.com/research/sota/interactive-planning-on-alfred-unseen-val.md?metric=Goal%20Completion%20(GC)>): Higher is better; unit: PERCENT.

- [HLP](<https://www.sota2.com/research/sota/interactive-planning-on-alfred-unseen-val.md?metric=HLP>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Success Rate (SR) | Result date | Report paper |
| --- | --- | --- | --- |
| Qwen2-VL-72B | 67.8 | Not recorded | 68fa75151e209131cea65976 |
| Previous SOTA | 67.7 | Not recorded | 68fa75151e209131cea65976 |
| Scene-LLM | 22.35 | Not recorded | 68fa729a1e209131cea576f4 |
| HLSM | 18.28 | Not recorded | 68fa729a1e209131cea576f4 |
| LLM-Planner | 15.36 | Not recorded | 68fa729a1e209131cea576f4 |
| LLM-Planner | 12.92 | Not recorded | 68fa729a1e209131cea576f4 |
| HITUT | 10.23 | Not recorded | 68fa729a1e209131cea576f4 |
| E.T. | 7.32 | Not recorded | 68fa729a1e209131cea576f4 |

### Qwen2-VL-72B

Success Rate (SR): 67.8. Result ID: 69938cbb3a6c31484916c661.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75151e209131cea65976.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75151e209131cea65976.md>)

[Implementation](<https://github.com/QwenLM/Qwen2-VL>)

Recorded evaluation configuration: {"Model Parameters":"72B"}. This record does not assert independent reproduction.

### Previous SOTA

Success Rate (SR): 67.7. Result ID: 69938cbb3a6c31484916c660.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75151e209131cea65976.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Scene-LLM

Success Rate (SR): 22.35. Result ID: 699247213a6c3148490dd5d2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa729a1e209131cea576f4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa729a1e209131cea576f4.md>)

Recorded evaluation configuration: {"Step-by-step instructions":false}. This record does not assert independent reproduction.

### HLSM

Success Rate (SR): 18.28. Result ID: 699247213a6c3148490dd5cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa729a1e209131cea576f4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b511e209131cea2d9e0.md>)

Recorded evaluation configuration: {"Step-by-step instructions":false}. This record does not assert independent reproduction.

### LLM-Planner

Success Rate (SR): 15.36. Result ID: 699247213a6c3148490dd5d1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa729a1e209131cea576f4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa707c1e209131cea4b636.md>)

Recorded evaluation configuration: {"Step-by-step instructions":true}. This record does not assert independent reproduction.

### LLM-Planner

Success Rate (SR): 12.92. Result ID: 699247213a6c3148490dd5ce.

[Reporting paper](<https://www.sota2.com/research/paper/68fa729a1e209131cea576f4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa707c1e209131cea4b636.md>)

Recorded evaluation configuration: {"Step-by-step instructions":false}. This record does not assert independent reproduction.

### HITUT

Success Rate (SR): 10.23. Result ID: 699247213a6c3148490dd5cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa729a1e209131cea576f4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a231e209131cea2644a.md>)

Recorded evaluation configuration: {"Step-by-step instructions":false}. This record does not assert independent reproduction.

### E.T.

Success Rate (SR): 7.32. Result ID: 699247213a6c3148490dd5cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa729a1e209131cea576f4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a951e209131cea290e6.md>)

Recorded evaluation configuration: {"Step-by-step instructions":true}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
