Building Blocks on Real-world robot tasks 1.0 (test)
80Success RateClaude-3.7
Evaluation results
| Method | Links | |
|---|---|---|
| Claude-3.7Tool Augmentation=w/2026.05 | 80 | |
| Claude-4.6Tool Augmentation=w/2026.05 | 80 | |
| Qwen2.5-32BTool Augmentation=w/2026.05 | 70 | |
| GPT-4oTool Augmentation=w/2026.05 | 60 | |
| GPT-5Tool Augmentation=w/2026.05 | 60 | |
| Qwen3-8BTool Augmentation=w/2026.05 | 50 | |
| Qwen3-32BTool Augmentation=w/2026.05 | 50 | |
| Qwen3.5-35BTool Augmentation=w/2026.05 | 50 | |
| GPT-4oTool Augmentation=w/o2026.05 | 0 | |
| GPT-5Tool Augmentation=w/o2026.05 | 0 | |
| Claude-3.7Tool Augmentation=w/o2026.05 | 0 | |
| Claude-4.6Tool Augmentation=w/o2026.05 | 0 | |
| Qwen3-8BTool Augmentation=w/o2026.05 | 0 | |
| Qwen3-32BTool Augmentation=w/o2026.05 | 0 | |
| Qwen2.5-32BTool Augmentation=w/o2026.05 | 0 | |
| Qwen3.5-35BTool Augmentation=w/o2026.05 | 0 |