Object-level reasoning on UNOBench real set (Overall)
74.3OPGemini Robotics-ER 1.5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini Robotics-ER 1.5Prompting Setting=Oracle (with SoM), Evaluation Protocol=ICL2025.11 | 74.3 | 69.9 | 68.8 | |
| UNOGraspPrompting Setting=Oracle (with SoM)2025.11 | 73.2 | 75.5 | 71.4 | |
| Gemini Robotics-ER 1.5Prompting Setting=Oracle (with SoM)2025.11 | 64.9 | 62.9 | 60.8 | |
| UNOGraspPrompting Setting=Natural Language Prompting2025.11 | 53.5 | 48.2 | 49.1 | |
| Qwen2.5-VLPrompting Setting=Oracle (with SoM), Evaluation Protocol=ICL2025.11 | 36.1 | 32.7 | 32.2 | |
| Qwen2.5-VLPrompting Setting=Natural Language Prompting, Evaluation Protocol=ICL2025.11 | 5.8 | 5.6 | 5.3 | |
| Gemini Robotics-ER 1.5Prompting Setting=Natural Language Prompting, Evaluation Protocol=ICL2025.11 | 3.8 | 3.2 | 3.3 | |
| Gemini Robotics-ER 1.5Prompting Setting=Natural Language Prompting2025.11 | 3.6 | 3.2 | 3.2 |