# Toy packing on Toy Unseen States (test) Source: [Toy packing on Toy Unseen States (test)]() Collection index: [llms.txt]() Data updated: 2026-06-25T08:52:57.632Z Evaluation of the 'Toy packing' task performance on the 'Toy Unseen States (test)' dataset, measured by Success Rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Toy packing | | Dataset (including any stated split) | Toy Unseen States (test) | | Metric | Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | ACT | 75.5 | Not recorded | 6a3cb673206542251d7ca868 | | ACT | 73 | Not recorded | 6a3cb673206542251d7ca868 | | π0 | 58 | Not recorded | 6a3cb673206542251d7ca868 | | DP | 56.5 | Not recorded | 6a3cb673206542251d7ca868 | | DP | 54 | Not recorded | 6a3cb673206542251d7ca868 | | SmolVLA | 53.5 | Not recorded | 6a3cb673206542251d7ca868 | | DP | 49.5 | Not recorded | 6a3cb673206542251d7ca868 | | SmolVLA | 49.5 | Not recorded | 6a3cb673206542251d7ca868 | | ACT | 49 | Not recorded | 6a3cb673206542251d7ca868 | | SmolVLA | 42 | Not recorded | 6a3cb673206542251d7ca868 | | π0 | 32.5 | Not recorded | 6a3cb673206542251d7ca868 | | π0 | 10 | Not recorded | 6a3cb673206542251d7ca868 | | ACT | 0 | Not recorded | 6a3cb673206542251d7ca868 | | DP | 0 | Not recorded | 6a3cb673206542251d7ca868 | | SmolVLA | 0 | Not recorded | 6a3cb673206542251d7ca868 | | π0 | 0 | Not recorded | 6a3cb673206542251d7ca868 | ### ACT Success Rate: 75.5. Result ID: 6a3cec56fbc373592c52bcfc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG"}. This record does not assert independent reproduction. ### ACT Success Rate: 73. Result ID: 6a3cec56fbc373592c52bcfa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"SMG\*"}. This record does not assert independent reproduction. ### π0 Success Rate: 58. Result ID: 6a3cec56fbc373592c52bd08. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG"}. This record does not assert independent reproduction. ### DP Success Rate: 56.5. Result ID: 6a3cec56fbc373592c52bcff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG\*"}. This record does not assert independent reproduction. ### DP Success Rate: 54. Result ID: 6a3cec56fbc373592c52bd00. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG"}. This record does not assert independent reproduction. ### SmolVLA Success Rate: 53.5. Result ID: 6a3cec56fbc373592c52bd04. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG"}. This record does not assert independent reproduction. ### DP Success Rate: 49.5. Result ID: 6a3cec56fbc373592c52bcfe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"SMG\*"}. This record does not assert independent reproduction. ### SmolVLA Success Rate: 49.5. Result ID: 6a3cec56fbc373592c52bd03. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG\*"}. This record does not assert independent reproduction. ### ACT Success Rate: 49. Result ID: 6a3cec56fbc373592c52bcfb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG\*"}. This record does not assert independent reproduction. ### SmolVLA Success Rate: 42. Result ID: 6a3cec56fbc373592c52bd02. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"SMG\*"}. This record does not assert independent reproduction. ### π0 Success Rate: 32.5. Result ID: 6a3cec56fbc373592c52bd07. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"DG\*"}. This record does not assert independent reproduction. ### π0 Success Rate: 10. Result ID: 6a3cec56fbc373592c52bd06. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"SMG\*"}. This record does not assert independent reproduction. ### ACT Success Rate: 0. Result ID: 6a3cec56fbc373592c52bcf9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"1 Src."}. This record does not assert independent reproduction. ### DP Success Rate: 0. Result ID: 6a3cec56fbc373592c52bcfd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"1 Src."}. This record does not assert independent reproduction. ### SmolVLA Success Rate: 0. Result ID: 6a3cec56fbc373592c52bd01. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"1 Src."}. This record does not assert independent reproduction. ### π0 Success Rate: 0. Result ID: 6a3cec56fbc373592c52bd05. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Augmentation Strategy":"1 Src."}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.