Manipulation on Language Table OOD
90Success RateGPT-5-Thinking-Tool
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-5-Thinking-ToolAccess level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Chain-of-thought (CoT) / Thinking mode=Thinking-Tool2025.09 | 90 | 77 | |
| GPT-5-ThinkingAccess level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 82 | 59 | |
| Uni-PlanModel scale (Parameters)=14B-A7B, Planning planner (Open-loop/Closed-loop)=Open-loop2025.09 | 73 | 70 | |
| Qwen2.5-VL-32B-Ins-CoTAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=32B, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 57 | 44 | |
| BAGEL-VLM-CoT (baseline, 7B)Access level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 51 | 41 | |
| Qwen2.5-VL-7B-Ins-CoTAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B, Chain-of-thought (CoT) / Thinking mode=True2025.09 | 36 | 26 | |
| Qwen2.5-VL-32B-InsAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=32B2025.09 | 28 | 25 | |
| VLPAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop2025.09 | 28 | 56 | |
| BAGEL-VLM (baseline, 7B)Access level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B2025.09 | 23 | 21 | |
| Qwen2.5-VL-7B-InsAccess level (Closed-source/Open-source)=Open-Source, Planning planner (Open-loop/Closed-loop)=Open-loop, Model scale (Parameters)=7B2025.09 | 14 | 14 | |
| GPT-5Access level (Closed-source/Open-source)=Closed-Source, Planning planner (Open-loop/Closed-loop)=Open-loop2025.09 | 0 | 12 |