Task Planning on MomaGraph-Bench 1.0 (Tier 3)
75AccuracyGPT-5
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5Reasoning Protocol=w/ Graph2025.12 | 75 | |
| Gemini-2.5-ProReasoning Protocol=w/ Graph2025.12 | 72.7 | |
| Claude-4.5-SonnetReasoning Protocol=w/ Graph2025.12 | 72.3 | |
| GPT-5Reasoning Protocol=w/o Graph2025.12 | 70.8 | |
| MomaGraph-R1Params=7B, Reasoning Protocol=w/ Graph2025.12 | 70.1 | |
| Claude-4.5-SonnetReasoning Protocol=w/o Graph2025.12 | 69.7 | |
| Gemini-2.5-ProReasoning Protocol=w/o Graph2025.12 | 67.5 | |
| MomaGraph-R1Params=7B, Reasoning Protocol=w/o Graph2025.12 | 63.6 | |
| DeepSeek-VL2Params=4.5B, Reasoning Protocol=w/o Graph2025.12 | 61.8 | |
| DeepSeek-VL2Params=4.5B, Reasoning Protocol=w/ Graph2025.12 | 61.3 | |
| InternVL2.5Params=8B, Reasoning Protocol=w/ Graph2025.12 | 59.7 | |
| LLaVA-OnevisionParams=7B, Reasoning Protocol=w/ Graph2025.12 | 59.2 | |
| LLaVA-OnevisionParams=7B, Reasoning Protocol=w/o Graph2025.12 | 58.4 | |
| Qwen2.5-VL-7B-InstructParams=7B, Reasoning Protocol=w/ Graph2025.12 | 57.1 | |
| InternVL2.5Params=8B, Reasoning Protocol=w/o Graph2025.12 | 55.8 | |
| Qwen2.5-VL-7B-InstructParams=7B, Reasoning Protocol=w/o Graph2025.12 | 51.9 | |
| LLaVA-V1.5Params=7B, Reasoning Protocol=w/o Graph2025.12 | 40.2 | |
| InstructBLIPParams=7B, Reasoning Protocol=w/o Graph2025.12 | 38.6 | |
| InstructBLIPParams=7B, Reasoning Protocol=w/ Graph2025.12 | 36.3 | |
| LLaVA-V1.5Params=7B, Reasoning Protocol=w/ Graph2025.12 | 36.3 |