Object-level reasoning on UNOBench real set Medium
75OPGemini Robotics-ER 1.5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini Robotics-ER 1.5Prompting Setting=Oracle (with SoM), Evaluation Protocol=ICL2025.11 | 75 | 46.6 | 54.3 | |
| UNOGraspPrompting Setting=Oracle (with SoM)2025.11 | 69 | 57.2 | 58.2 | |
| Gemini Robotics-ER 1.5Prompting Setting=Oracle (with SoM)2025.11 | 66.7 | 43.3 | 49.4 | |
| UNOGraspPrompting Setting=Natural Language Prompting2025.11 | 47 | 26.1 | 32.1 | |
| Qwen2.5-VLPrompting Setting=Oracle (with SoM), Evaluation Protocol=ICL2025.11 | 36.8 | 18.6 | 23.3 | |
| Qwen2.5-VLPrompting Setting=Natural Language Prompting, Evaluation Protocol=ICL2025.11 | 5.1 | 2.7 | 3.3 | |
| Gemini Robotics-ER 1.5Prompting Setting=Natural Language Prompting, Evaluation Protocol=ICL2025.11 | 4.8 | 2.5 | 3.2 | |
| Gemini Robotics-ER 1.5Prompting Setting=Natural Language Prompting2025.11 | 2.9 | 1.4 | 1.8 |