Control Code Generation on Robotic Headphone Manipulation Task 4 1.0 (test)
100R-L ScoreOurs
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Ours2025.02 | 100 | 96.2 | 99 | 96 | |
| Text-guided VLMChain-of-Thought (COT)=True2025.02 | 88 | — | 93 | 72 | |
| Ours (-2D Prompt)2D Prompting=False2025.02 | 88 | 0 | 25 | 0 | |
| End2End VLM2025.02 | 68 | 0 | 25 | 0 | |
| Text-guided VLM2025.02 | 68 | — | 86.5 | 46 | |
| 3D Multimodal LM2025.02 | 68 | 78.1 | 93 | 74 | |
| Ours (-SLM)Supervised Learning Module (SLM)=False2025.02 | 68 | 84.7 | 95.5 | 82 | |
| Text-guided LLM2025.02 | 59 | — | 78.5 | 14 |