Put Carrot on Plate on SimplerEnv WidowX
0.987Success RateIPI
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IPIBase Model=Pi0.5, Framework=StARe2025.12 | 0.987 | 0.997 | |
| IPIBase Model=OpenVLA-7B, Framework=StARe2025.12 | 0.985 | 0.995 | |
| StA-PPOBase Model=Pi0.5, Fine-tuning Protocol=SFT → StA-PPO(StARe)2025.12 | 0.977 | 0.99 | |
| π_RLBase Model=Pi0.5, Fine-tuning Protocol=RL2025.12 | 0.973 | 0.993 | |
| StA-PPOBase Model=OpenVLA-7B, Fine-tuning Protocol=SFT → StA-PPO(StARe)2025.12 | 0.953 | 0.99 | |
| RL4VLABase Model=OpenVLA-7B, Fine-tuning Protocol=RL4VLA2025.12 | 0.913 | 0.967 | |
| SOFARBase Model=SOFAR2025.12 | 0.667 | 0.75 | |
| StA-TPOBase Model=Pi0.5, Fine-tuning Protocol=SFT → StA-TPO(StARe)2025.12 | 0.653 | 0.803 | |
| SFTBase Model=Pi0.5, Fine-tuning Protocol=SFT2025.12 | 0.647 | 0.893 | |
| GRAPEBase Model=Pi0.5, Fine-tuning Protocol=GRAPE2025.12 | 0.593 | 0.883 | |
| StA-TPOBase Model=OpenVLA-7B, Fine-tuning Protocol=SFT → StA-TPO(StARe)2025.12 | 0.573 | 0.823 | |
| GRAPEBase Model=OpenVLA-7B, Fine-tuning Protocol=GRAPE2025.12 | 0.55 | 0.853 | |
| SFTBase Model=OpenVLA-7B, Fine-tuning Protocol=SFT2025.12 | 0.527 | 0.747 | |
| RoboVLMBase Model=RoboVLM2025.12 | 0.25 | 0.333 | |
| SpatialVLABase Model=SpatialVLA2025.12 | 0.208 | 0.417 | |
| Octo-SmallBase Model=Octo-Small2025.12 | 0.097 | 0.278 | |
| Octo-BaseBase Model=Octo-Base2025.12 | 0.083 | 0.528 | |
| RT-1-XBase Model=RT-1-X2025.12 | 0.042 | 0.208 |