# Proactive Assistance on VirtualHome v2.2.4 (Apartments #3 and #6)

Source: [Proactive Assistance on VirtualHome v2.2.4 (Apartments #3 and #6)](<https://www.sota2.com/research/sota/proactive-assistance-on-virtualhome-v2-2-4-apartments-sharp-3-and-sharp-6>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T07:25:34.959Z

Evaluation of proactive assistance capabilities within specific configurations (Apartments #3 and #6) of the VirtualHome v2.2.4 environment, measured by efficiency metrics like Average Steps and Speedup percentage.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Proactive Assistance |
| Dataset (including any stated split) | VirtualHome v2.2.4 (Apartments #3 and #6) |
| Metric | Speedup (%) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 22 of 22 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Speedup (%)](<https://www.sota2.com/research/sota/proactive-assistance-on-virtualhome-v2-2-4-apartments-sharp-3-and-sharp-6.md?metric=Speedup%20(%25)>): Higher is better; unit: PERCENT.

- [Average Steps](<https://www.sota2.com/research/sota/proactive-assistance-on-virtualhome-v2-2-4-apartments-sharp-3-and-sharp-6.md?metric=Average%20Steps>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Speedup (%) | Result date | Report paper |
| --- | --- | --- | --- |
| Gemini-3-Flash | 38.41 | Not recorded | 6a1e6372dbd7150506f85103 |
| MindZero | 37.5 | Not recorded | 6a1e6372dbd7150506f85103 |
| Gemini-3-Flash | 26.1 | Not recorded | 6a1e6372dbd7150506f85103 |
| Qwen3-4B | 23.67 | Not recorded | 6a1e6372dbd7150506f85103 |
| Gemini-3-Flash | 23.4 | Not recorded | 6a1e6372dbd7150506f85103 |
| Gemini-3-Flash | 21.55 | Not recorded | 6a1e6372dbd7150506f85103 |
| MindZero | 19.7 | Not recorded | 6a1e6372dbd7150506f85103 |
| MindZero | 18.28 | Not recorded | 6a1e6372dbd7150506f85103 |
| MindZero | 15.45 | Not recorded | 6a1e6372dbd7150506f85103 |
| Qwen3-4B | 9.23 | Not recorded | 6a1e6372dbd7150506f85103 |
| Qwen3-4B | 9 | Not recorded | 6a1e6372dbd7150506f85103 |
| MindZero | 7.63 | Not recorded | 6a1e6372dbd7150506f85103 |
| Gemini-3-Flash | 7.58 | Not recorded | 6a1e6372dbd7150506f85103 |
| Gemini-3-Flash | 6.4 | Not recorded | 6a1e6372dbd7150506f85103 |
| MindZero | 6.3 | Not recorded | 6a1e6372dbd7150506f85103 |
| Qwen3-4B | 2.62 | Not recorded | 6a1e6372dbd7150506f85103 |
| Qwen3-4B | -3.92 | Not recorded | 6a1e6372dbd7150506f85103 |
| Qwen3-4B | -18.5 | Not recorded | 6a1e6372dbd7150506f85103 |

### Gemini-3-Flash

Speedup (%): 38.41. Result ID: 6a1e8525fbc373592c183c2f.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

Recorded evaluation configuration: {"Task ID":"3"}. This record does not assert independent reproduction.

### MindZero

Speedup (%): 37.5. Result ID: 6a1e8525fbc373592c183c2e.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Implementation](<https://github.com/SCAI-JHU/MindZero>)

Recorded evaluation configuration: {"Task ID":"3","Base Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Gemini-3-Flash

Speedup (%): 26.1. Result ID: 6a1e8525fbc373592c183c3b.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

Recorded evaluation configuration: {"Task ID":"13"}. This record does not assert independent reproduction.

### Qwen3-4B

Speedup (%): 23.67. Result ID: 6a1e8525fbc373592c183c2d.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Task ID":"3"}. This record does not assert independent reproduction.

### Gemini-3-Flash

Speedup (%): 23.4. Result ID: 6a1e8525fbc373592c183c3f.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

Recorded evaluation configuration: {"Task ID":"Average"}. This record does not assert independent reproduction.

### Gemini-3-Flash

Speedup (%): 21.55. Result ID: 6a1e8525fbc373592c183c33.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

Recorded evaluation configuration: {"Task ID":"5"}. This record does not assert independent reproduction.

### MindZero

Speedup (%): 19.7. Result ID: 6a1e8525fbc373592c183c3e.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Implementation](<https://github.com/SCAI-JHU/MindZero>)

Recorded evaluation configuration: {"Task ID":"Average","Base Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### MindZero

Speedup (%): 18.28. Result ID: 6a1e8525fbc373592c183c3a.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Implementation](<https://github.com/SCAI-JHU/MindZero>)

Recorded evaluation configuration: {"Task ID":"13","Base Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### MindZero

Speedup (%): 15.45. Result ID: 6a1e8525fbc373592c183c36.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Implementation](<https://github.com/SCAI-JHU/MindZero>)

Recorded evaluation configuration: {"Task ID":"8","Base Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Qwen3-4B

Speedup (%): 9.23. Result ID: 6a1e8525fbc373592c183c35.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Task ID":"8"}. This record does not assert independent reproduction.

### Qwen3-4B

Speedup (%): 9. Result ID: 6a1e8525fbc373592c183c40.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Task ID":"Standard Error"}. This record does not assert independent reproduction.

### MindZero

Speedup (%): 7.63. Result ID: 6a1e8525fbc373592c183c32.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Implementation](<https://github.com/SCAI-JHU/MindZero>)

Recorded evaluation configuration: {"Task ID":"5","Base Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Gemini-3-Flash

Speedup (%): 7.58. Result ID: 6a1e8525fbc373592c183c37.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

Recorded evaluation configuration: {"Task ID":"8"}. This record does not assert independent reproduction.

### Gemini-3-Flash

Speedup (%): 6.4. Result ID: 6a1e8525fbc373592c183c42.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

Recorded evaluation configuration: {"Task ID":"Standard Error"}. This record does not assert independent reproduction.

### MindZero

Speedup (%): 6.3. Result ID: 6a1e8525fbc373592c183c41.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Implementation](<https://github.com/SCAI-JHU/MindZero>)

Recorded evaluation configuration: {"Task ID":"Standard Error","Base Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Qwen3-4B

Speedup (%): 2.62. Result ID: 6a1e8525fbc373592c183c3d.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Task ID":"Average"}. This record does not assert independent reproduction.

### Qwen3-4B

Speedup (%): -3.92. Result ID: 6a1e8525fbc373592c183c39.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Task ID":"13"}. This record does not assert independent reproduction.

### Qwen3-4B

Speedup (%): -18.5. Result ID: 6a1e8525fbc373592c183c31.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6372dbd7150506f85103.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Task ID":"5"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
