Reasoning Pointing on InstructPart (test)
90Patch AccuracyMolmo-7B (Ours)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Molmo-7B (Ours)Model Category=MLLM w/ pointing ability, Evaluation Mode=Ours (Q-Synth + A2P)2026.06 | 90 | 86.8 | |
| Qwen2.5-VL-7B (Ours)Model Category=MLLM w/ pointing ability, Evaluation Mode=Ours (Q-Synth + A2P)2026.06 | 87.7 | 81.8 | |
| LLaVA-1.5-7B (Ours)Model Category=MLLM w/o pointing ability, Evaluation Mode=Ours (Q-Synth + A2P)2026.06 | 80.3 | 78.3 | |
| Molmo-7B text pointingModel Category=MLLM w/ pointing ability, Evaluation Mode=text pointing2026.06 | 73.7 | 71 | |
| Qwen2.5-VL-7B text pointingModel Category=MLLM w/ pointing ability, Evaluation Mode=text pointing2026.06 | 72.2 | 70.8 | |
| Molmo-7B attention pointingModel Category=MLLM w/ pointing ability, Evaluation Mode=attention pointing2026.06 | 46.8 | 37.8 | |
| Qwen2.5-VL-7B attention pointingModel Category=MLLM w/ pointing ability, Evaluation Mode=attention pointing2026.06 | 35.2 | 28.3 | |
| LLaVA-1.5-7B attention pointingModel Category=MLLM w/o pointing ability, Evaluation Mode=attention pointing2026.06 | 22.7 | 19.4 | |
| X-DecoderModel Category=Segmentation-based Models2026.06 | 18.5 | 17.8 | |
| LLaVA-1.5-7B text pointingModel Category=MLLM w/o pointing ability, Evaluation Mode=text pointing2026.06 | 4 | 3.3 | |
| VLPartModel Category=Segmentation-based Models2026.06 | 0.8 | 0.8 |