Task Planning on MomaGraph-Bench Tier 2 1.0
71.9AccuracyMomaGraph-R1
Evaluation Results
| Method | Links | |
|---|---|---|
| MomaGraph-R1Params=7B, Reasoning Protocol=w/ Graph2025.12 | 71.9 | |
| Claude-4.5-SonnetReasoning Protocol=w/ Graph2025.12 | 70.3 | |
| Gemini-2.5-ProReasoning Protocol=w/ Graph2025.12 | 69.5 | |
| GPT-5Reasoning Protocol=w/ Graph2025.12 | 68.2 | |
| Claude-4.5-SonnetReasoning Protocol=w/o Graph2025.12 | 67 | |
| Gemini-2.5-ProReasoning Protocol=w/o Graph2025.12 | 65.8 | |
| MomaGraph-R1Params=7B, Reasoning Protocol=w/o Graph2025.12 | 65.8 | |
| GPT-5Reasoning Protocol=w/o Graph2025.12 | 63.4 | |
| Qwen2.5-VL-7B-InstructParams=7B, Reasoning Protocol=w/o Graph2025.12 | 58.5 | |
| Qwen2.5-VL-7B-InstructParams=7B, Reasoning Protocol=w/ Graph2025.12 | 58.5 | |
| LLaVA-OnevisionParams=7B, Reasoning Protocol=w/ Graph2025.12 | 56 | |
| DeepSeek-VL2Params=4.5B, Reasoning Protocol=w/ Graph2025.12 | 53.6 | |
| InternVL2.5Params=8B, Reasoning Protocol=w/ Graph2025.12 | 53 | |
| LLaVA-OnevisionParams=7B, Reasoning Protocol=w/o Graph2025.12 | 52.4 | |
| DeepSeek-VL2Params=4.5B, Reasoning Protocol=w/o Graph2025.12 | 51.2 | |
| InternVL2.5Params=8B, Reasoning Protocol=w/o Graph2025.12 | 51.2 | |
| LLaVA-V1.5Params=7B, Reasoning Protocol=w/ Graph2025.12 | 48.7 | |
| LLaVA-V1.5Params=7B, Reasoning Protocol=w/o Graph2025.12 | 46.3 | |
| InstructBLIPParams=7B, Reasoning Protocol=w/o Graph2025.12 | 42.6 | |
| InstructBLIPParams=7B, Reasoning Protocol=w/ Graph2025.12 | 41.4 |