Step Completion on CoSPlan Shuffle-E
0.301AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oReasoning Strategy=Scene Graph2025.12 | 0.301 | |
| GPT-4oReasoning Strategy=Chain-of-Thought2025.12 | 0.276 | |
| CoG-VLMReasoning Strategy=Chain-of-Thought2025.12 | 0.271 | |
| Qwen2 VL-8BReasoning Strategy=Scene Graph2025.12 | 0.251 | |
| Qwen2 VL-8BReasoning Strategy=Chain-of-Thought2025.12 | 0.249 | |
| Qwen2 VL-8BReasoning Strategy=Vanilla2025.12 | 0.241 | |
| CoG-VLMReasoning Strategy=Scene Graph2025.12 | 0.237 | |
| Janus-pro-7BReasoning Strategy=Scene Graph2025.12 | 0.235 | |
| Intern-VLMReasoning Strategy=Scene Graph2025.12 | 0.234 | |
| Janus-pro-7BReasoning Strategy=Vanilla2025.12 | 0.232 | |
| Intern-VLMReasoning Strategy=Chain-of-Thought2025.12 | 0.232 | |
| CoG-VLMReasoning Strategy=Vanilla2025.12 | 0.231 | |
| Janus-pro-7BReasoning Strategy=Chain-of-Thought2025.12 | 0.231 | |
| Intern-VLMReasoning Strategy=Vanilla2025.12 | 0.201 | |
| Random2025.12 | 0.2 |