# Physical Red Teaming on RedVLA State-Level Scenarios Source: [Physical Red Teaming on RedVLA State-Level Scenarios]() Collection index: [llms.txt]() Data updated: 2026-04-27T07:39:51.123Z Evaluation of model performance in physical red teaming scenarios using the RedVLA State-Level Scenarios dataset, measured by Attack Success Rate (ASR) and Success Rate (SR). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Physical Red Teaming | | Dataset (including any stated split) | RedVLA State-Level Scenarios | | Metric | Attack Success Rate (ASR) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Attack Success Rate (ASR)](): Higher is better; unit: PERCENT. - [Success Rate (SR)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Attack Success Rate (ASR) | Result date | Report paper | | --- | --- | --- | --- | | π0 | 98.4 | Not recorded | 69eeed6a55a3c32af89f9657 | | π0.5 | 98.4 | Not recorded | 69eeed6a55a3c32af89f9657 | | VLA-Adapter | 97.1 | Not recorded | 69eeed6a55a3c32af89f9657 | | OpenVLA | 96.9 | Not recorded | 69eeed6a55a3c32af89f9657 | | VLA-Adapter-Pro | 96.9 | Not recorded | 69eeed6a55a3c32af89f9657 | | π0 | 96.6 | Not recorded | 69eeed6a55a3c32af89f9657 | | OpenVLA | 96.6 | Not recorded | 69eeed6a55a3c32af89f9657 | | OpenVLA-OFT | 96.3 | Not recorded | 69eeed6a55a3c32af89f9657 | | VLA-Adapter-Pro | 96.3 | Not recorded | 69eeed6a55a3c32af89f9657 | | π0.5 | 96.3 | Not recorded | 69eeed6a55a3c32af89f9657 | | VLA-Adapter | 96.2 | Not recorded | 69eeed6a55a3c32af89f9657 | | π0.5 | 95 | Not recorded | 69eeed6a55a3c32af89f9657 | | π0 | 94.7 | Not recorded | 69eeed6a55a3c32af89f9657 | | OpenVLA-OFT | 94.7 | Not recorded | 69eeed6a55a3c32af89f9657 | | VLA-Adapter-Pro | 94.1 | Not recorded | 69eeed6a55a3c32af89f9657 | | OpenVLA-OFT | 93.8 | Not recorded | 69eeed6a55a3c32af89f9657 | | OpenVLA | 91.2 | Not recorded | 69eeed6a55a3c32af89f9657 | | VLA-Adapter | 88.8 | Not recorded | 69eeed6a55a3c32af89f9657 | ### π0 Attack Success Rate (ASR): 98.4. Result ID: 69ef115947f34ce924d4ef38. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Robot Damage"}. This record does not assert independent reproduction. ### π0.5 Attack Success Rate (ASR): 98.4. Result ID: 69ef115947f34ce924d4ef39. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Robot Damage"}. This record does not assert independent reproduction. ### VLA-Adapter Attack Success Rate (ASR): 97.1. Result ID: 69ef115947f34ce924d4ef2a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Resource Damage"}. This record does not assert independent reproduction. ### OpenVLA Attack Success Rate (ASR): 96.9. Result ID: 69ef115947f34ce924d4ef28. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Scenario":"Resource Damage"}. This record does not assert independent reproduction. ### VLA-Adapter-Pro Attack Success Rate (ASR): 96.9. Result ID: 69ef115947f34ce924d4ef37. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Robot Damage"}. This record does not assert independent reproduction. ### π0 Attack Success Rate (ASR): 96.6. Result ID: 69ef115947f34ce924d4ef2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Resource Damage"}. This record does not assert independent reproduction. ### OpenVLA Attack Success Rate (ASR): 96.6. Result ID: 69ef115947f34ce924d4ef34. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Scenario":"Robot Damage"}. This record does not assert independent reproduction. ### OpenVLA-OFT Attack Success Rate (ASR): 96.3. Result ID: 69ef115947f34ce924d4ef29. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Resource Damage"}. This record does not assert independent reproduction. ### VLA-Adapter-Pro Attack Success Rate (ASR): 96.3. Result ID: 69ef115947f34ce924d4ef2b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Resource Damage"}. This record does not assert independent reproduction. ### π0.5 Attack Success Rate (ASR): 96.3. Result ID: 69ef115947f34ce924d4ef2d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Resource Damage"}. This record does not assert independent reproduction. ### VLA-Adapter Attack Success Rate (ASR): 96.2. Result ID: 69ef115947f34ce924d4ef36. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Robot Damage"}. This record does not assert independent reproduction. ### π0.5 Attack Success Rate (ASR): 95. Result ID: 69ef115947f34ce924d4ef33. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Dangerous Item Misuse"}. This record does not assert independent reproduction. ### π0 Attack Success Rate (ASR): 94.7. Result ID: 69ef115947f34ce924d4ef32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Dangerous Item Misuse"}. This record does not assert independent reproduction. ### OpenVLA-OFT Attack Success Rate (ASR): 94.7. Result ID: 69ef115947f34ce924d4ef35. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Robot Damage"}. This record does not assert independent reproduction. ### VLA-Adapter-Pro Attack Success Rate (ASR): 94.1. Result ID: 69ef115947f34ce924d4ef31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Dangerous Item Misuse"}. This record does not assert independent reproduction. ### OpenVLA-OFT Attack Success Rate (ASR): 93.8. Result ID: 69ef115947f34ce924d4ef2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Dangerous Item Misuse"}. This record does not assert independent reproduction. ### OpenVLA Attack Success Rate (ASR): 91.2. Result ID: 69ef115947f34ce924d4ef2e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Scenario":"Dangerous Item Misuse"}. This record does not assert independent reproduction. ### VLA-Adapter Attack Success Rate (ASR): 88.8. Result ID: 69ef115947f34ce924d4ef30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Scenario":"Dangerous Item Misuse"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.