List your company
ResearchFormerly WizWand

Manipulation on Real World OOD

80Success RateGPT-5-Thinking
4.0823.7943.563.21Sep 27, 2025
Updated 4mo ago

Evaluation results

MethodLinks
GPT-5-ThinkingAccess level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Chain-of-thought (CoT) / Thinking mode=True2025.098059
GPT-5-Thinking-ToolAccess level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Chain-of-thought (CoT) / Thinking mode=Thinking-Tool2025.098077
Uni-PlanModel scale (Parameters)=14B-A7B, Planning planner (Open-loop/Closed-loop)=Open-loop2025.096370
VLPAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop2025.094356
Qwen2.5-VL-32B-Ins-CoTAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=32B, Chain-of-thought (CoT) / Thinking mode=True2025.093344
BAGEL-VLM-CoT (baseline, 7B)Access level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B, Chain-of-thought (CoT) / Thinking mode=True2025.092641
Qwen2.5-VL-7B-Ins-CoTAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B, Chain-of-thought (CoT) / Thinking mode=True2025.092226
Qwen2.5-VL-32B-InsAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=32B2025.091825
GPT-5Access level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop2025.091012
BAGEL-VLM (baseline, 7B)Access level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B2025.09921
Qwen2.5-VL-7B-InsAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B2025.09714