Robot-Centric MindPower Reasoning on MindPower Image-input (test)
0.3307Perception (BERTScore)GPT-4o
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4oInput Modality=Image2025.11 | 0.3307 | 0.4837 | 0.3005 | 0.3947 | 0.3116 | 0.3275 | 0.1616 | 0.2955 | 0.1996 | 0.3435 | 1.82 | 2.91 | 8.05 | |
| Qwen2.5-VL-7B-InstructInput Modality=Image2025.11 | 0.2489 | 0.3997 | 0.1946 | 0.2921 | 0.2259 | 0.1914 | 0.168 | 0.2349 | 0.1911 | 0.2379 | 0.15 | 0.15 | 6.72 | |
| LLaVA-OV-8BInput Modality=Image2025.11 | 0.0808 | 0.2645 | 0.1509 | 0.2321 | 0.2231 | 0.214 | 0.1621 | 0.1958 | 0.1711 | 0.2125 | 0 | 0 | 6.45 | |
| InternVL3.5-8BInput Modality=Image2025.11 | 0.0643 | 0.1878 | 0.1571 | 0.2077 | 0.193 | 0.1738 | 0.1397 | 0.1972 | 0.1262 | 0.1877 | 0 | 0 | 5.95 |