Robot Manipulation and Scene Understanding on Simulation Manipulation Scenarios Stage 20 (test)
83.6Reachable Success RateQwen3-VL-4B-Instruct
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Qwen3-VL-4B-InstructType=VLM, Parameters=4B2026.06 | 83.6 | 8.6 | 8.51 | 97.4 | 99.2 | 6 | |
| Qwen3-14BParameters=14B2026.06 | 81.2 | 12.3 | 7.68 | 97.8 | 96.7 | 6.2 | |
| Qwen3-4BParameters=4B2026.06 | 80.9 | 13.1 | 7.72 | 97.4 | 97.3 | 5.4 | |
| Qwen3-8BParameters=8B2026.06 | 80.4 | 13.4 | 7.67 | 96.2 | 96.4 | 5.4 | |
| Qwen3-VL-8B-InstructType=VLM, Parameters=8B2026.06 | 79 | 12.3 | 7.87 | 98.5 | 98.8 | 6.9 | |
| Qwen3-VL-2B-InstructType=VLM, Parameters=2B2026.06 | 78.8 | 8 | 9.24 | 96.8 | 99.1 | 6.9 | |
| Qwen3-0.6BParameters=0.6B2026.06 | 77.4 | 13.1 | 8.43 | 94.9 | 93.9 | 5.7 | |
| Qwen3-1.7BParameters=1.7B2026.06 | 77.2 | 14.8 | 7.68 | 95.3 | 96.3 | 6.4 | |
| Llama-3.2-3B-InstructParameters=3B2026.06 | 73 | 18.1 | 8.07 | 97.9 | 95.4 | 5.8 | |
| Llama-3.2-1B-InstructParameters=1B2026.06 | 63.9 | 21 | 7.81 | 97 | 93.6 | 12.8 | |
| gemma-3-4b-itInput=image2026.06 | 7 | 45.2 | 12.67 | 96.4 | 98.9 | 17.8 | |
| gemma-3-4b-itInput=text2026.06 | 1.2 | 74.1 | 5.91 | 78.4 | 86.7 | 17.4 |