Drawer Opening on SimplerEnv Google Robot embodiment (test)
64Success RateDUALVLA
Evaluation Results
| Method | Links | |
|---|---|---|
| DUALVLAEvaluation Protocol=Variance Aggregation (VA)2025.11 | 64 | |
| DUALVLAEvaluation Protocol=Visual Matching (VM)2025.11 | 63.9 | |
| TraceVLAEvaluation Protocol=Visual Matching (VM)2025.11 | 63.1 | |
| OpenVLAEvaluation Protocol=Visual Matching (VM)2025.11 | 63 | |
| TraceVLAEvaluation Protocol=Variance Aggregation (VA)2025.11 | 61.6 | |
| InstructVLA-EEvaluation Protocol=Variance Aggregation (VA)2025.11 | 60.6 | |
| RT-1-XEvaluation Protocol=Visual Matching (VM)2025.11 | 59.7 | |
| SpatialVLAEvaluation Protocol=Visual Matching (VM)2025.11 | 57.4 | |
| InstructVLA-GEvaluation Protocol=Variance Aggregation (VA)2025.11 | 55.2 | |
| InstructVLA-GEvaluation Protocol=Visual Matching (VM)2025.11 | 55 | |
| ThinkACTEvaluation Protocol=Visual Matching (VM)2025.11 | 50 | |
| ThinkACTEvaluation Protocol=Variance Aggregation (VA)2025.11 | 47.6 | |
| InstructVLA-EEvaluation Protocol=Visual Matching (VM)2025.11 | 47.2 | |
| RoboVLMsEvaluation Protocol=Visual Matching (VM)2025.11 | 43.5 | |
| SpatialVLAEvaluation Protocol=Variance Aggregation (VA)2025.11 | 41.8 | |
| RT-2-XEvaluation Protocol=Variance Aggregation (VA)2025.11 | 35.5 | |
| RT-1-XEvaluation Protocol=Variance Aggregation (VA)2025.11 | 29.4 | |
| OpenVLAEvaluation Protocol=Variance Aggregation (VA)2025.11 | 28.8 | |
| RT-2-XEvaluation Protocol=Visual Matching (VM)2025.11 | 25 | |
| Octo-BaseEvaluation Protocol=Visual Matching (VM)2025.11 | 22.7 | |
| Emma-XEvaluation Protocol=Variance Aggregation (VA)2025.11 | 20.5 | |
| Emma-XEvaluation Protocol=Visual Matching (VM)2025.11 | 18.3 | |
| RoboVLMsEvaluation Protocol=Variance Aggregation (VA)2025.11 | 10.6 | |
| MagmaEvaluation Protocol=Visual Matching (VM)2025.11 | 9.7 | |
| MagmaEvaluation Protocol=Variance Aggregation (VA)2025.11 | 5.8 | |
| Octo-BaseEvaluation Protocol=Variance Aggregation (VA)2025.11 | 1.1 | |
| ECoTEvaluation Protocol=Visual Matching (VM)2025.11 | 0 | |
| ECoTEvaluation Protocol=Variance Aggregation (VA)2025.11 | 0 |