# Process-constrained task execution on FullHome (VirtualHome) Source: [Process-constrained task execution on FullHome (VirtualHome)]() Collection index: [llms.txt]() Data updated: 2026-05-19T12:18:12.762Z Evaluation of model performance on process-constrained task execution using the FullHome subset of the VirtualHome environment, measured by Process Success Rate (Process SR). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Process-constrained task execution | | Dataset (including any stated split) | FullHome (VirtualHome) | | Metric | Process Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Process Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Process Success Rate | Result date | Report paper | | --- | --- | --- | --- | | TaskGround | 51.4 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 46 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 45.7 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 42.9 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 40 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 40 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 37.1 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 37 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 36 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 35.5 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 34.3 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 34 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 31.4 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 29 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 26 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 25.7 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 23.3 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 23 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 19 | Not recorded | 6a0beed3dbc836b87d82c74e | | TaskGround | 19 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 17.1 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 15 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 14.3 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 11.4 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 10 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 5.7 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 5.7 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 5 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 4 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 2 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 1 | Not recorded | 6a0beed3dbc836b87d82c74e | | Naive | 1 | Not recorded | 6a0beed3dbc836b87d82c74e | ### TaskGround Process Success Rate: 51.4. Result ID: 6a0c54fefbc373592c03b6ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-5"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 46. Result ID: 6a0c54fefbc373592c03b68d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-5"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 45.7. Result ID: 6a0c54fefbc373592c03b6a9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4.1"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 42.9. Result ID: 6a0c54fefbc373592c03b6af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"DeepSeek-V4-Flash"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 40. Result ID: 6a0c54fefbc373592c03b6b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"MiMo-V2-Flash"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 40. Result ID: 6a0c54fefbc373592c03b6b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3.5-9B"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 37.1. Result ID: 6a0c54fefbc373592c03b6ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 37. Result ID: 6a0c54fefbc373592c03b687. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 36. Result ID: 6a0c54fefbc373592c03b68f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"DeepSeek-V4-Flash"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 35.5. Result ID: 6a0c54fefbc373592c03b6a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 34.3. Result ID: 6a0c54fefbc373592c03b6b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-12B"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 34. Result ID: 6a0c54fefbc373592c03b689. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4.1"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 31.4. Result ID: 6a0c54fefbc373592c03b6ac. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-5"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 29. Result ID: 6a0c54fefbc373592c03b695. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3.5-9B"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 26. Result ID: 6a0c54fefbc373592c03b68c. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-5"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 25.7. Result ID: 6a0c54fefbc373592c03b6ae. [Reporting paper]() Recorded evaluation configuration: {"Model":"DeepSeek-V4-Flash"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 23.3. Result ID: 6a0c54fefbc373592c03b6a6. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 23. Result ID: 6a0c54fefbc373592c03b691. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"MiMo-V2-Flash"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 19. Result ID: 6a0c54fefbc373592c03b68b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### TaskGround Process Success Rate: 19. Result ID: 6a0c54fefbc373592c03b693. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-12B"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 17.1. Result ID: 6a0c54fefbc373592c03b6a8. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4.1"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 15. Result ID: 6a0c54fefbc373592c03b68e. [Reporting paper]() Recorded evaluation configuration: {"Model":"DeepSeek-V4-Flash"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 14.3. Result ID: 6a0c54fefbc373592c03b6b4. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3.5-9B"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 11.4. Result ID: 6a0c54fefbc373592c03b6b0. [Reporting paper]() Recorded evaluation configuration: {"Model":"MiMo-V2-Flash"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 10. Result ID: 6a0c54fefbc373592c03b694. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3.5-9B"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 5.7. Result ID: 6a0c54fefbc373592c03b6aa. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 5.7. Result ID: 6a0c54fefbc373592c03b6b2. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemma-3-12B"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 5. Result ID: 6a0c54fefbc373592c03b686. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 4. Result ID: 6a0c54fefbc373592c03b688. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4.1"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 2. Result ID: 6a0c54fefbc373592c03b68a. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 1. Result ID: 6a0c54fefbc373592c03b690. [Reporting paper]() Recorded evaluation configuration: {"Model":"MiMo-V2-Flash"}. This record does not assert independent reproduction. ### Naive Process Success Rate: 1. Result ID: 6a0c54fefbc373592c03b692. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemma-3-12B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.