Manipulation on Real World OOD
80Success RateGPT-5-Thinking
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-5-ThinkingAccess level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 80 | 59 | |
| GPT-5-Thinking-ToolAccess level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Chain-of-thought (CoT) / Thinking mode=Thinking-Tool2025.09 | 80 | 77 | |
| Uni-PlanModel scale (Parameters)=14B-A7B, Planning planner (Open-loop/Closed-loop)=Open-loop2025.09 | 63 | 70 | |
| VLPAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop2025.09 | 43 | 56 | |
| Qwen2.5-VL-32B-Ins-CoTAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=32B, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 33 | 44 | |
| BAGEL-VLM-CoT (baseline, 7B)Access level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 26 | 41 | |
| Qwen2.5-VL-7B-Ins-CoTAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 22 | 26 | |
| Qwen2.5-VL-32B-InsAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=32B2025.09 | 18 | 25 | |
| GPT-5Access level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop2025.09 | 10 | 12 | |
| BAGEL-VLM (baseline, 7B)Access level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B2025.09 | 9 | 21 | |
| Qwen2.5-VL-7B-InsAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B2025.09 | 7 | 14 |