Object-level reasoning on UNOBench real set (Hard)
56.4OPGemini Robotics-ER 1.5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini Robotics-ER 1.5Prompting Setting=Oracle (with SoM), Evaluation Protocol=ICL2025.11 | 56.4 | 18 | 26.4 | |
| UNOGraspPrompting Setting=Oracle (with SoM)2025.11 | 55.6 | 43.9 | 44.7 | |
| Gemini Robotics-ER 1.5Prompting Setting=Oracle (with SoM)2025.11 | 41.7 | 19.3 | 24.4 | |
| UNOGraspPrompting Setting=Natural Language Prompting2025.11 | 35.6 | 15.6 | 20.6 | |
| Qwen2.5-VLPrompting Setting=Oracle (with SoM), Evaluation Protocol=ICL2025.11 | 30.9 | 10.2 | 13.1 | |
| Qwen2.5-VLPrompting Setting=Natural Language Prompting, Evaluation Protocol=ICL2025.11 | 11.4 | 3.2 | 4.9 | |
| Gemini Robotics-ER 1.5Prompting Setting=Natural Language Prompting2025.11 | 10.2 | 2.6 | 3.8 | |
| Gemini Robotics-ER 1.5Prompting Setting=Natural Language Prompting, Evaluation Protocol=ICL2025.11 | 9.1 | 1.7 | 2.8 |