Multi-robot coordination on SimWorld 2 robots (IV.A)
90SRCaPE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CaPEBase Model=Qwen 2.5 7B, Finetuned=true2026.02 | 90 | 18 | 7 | 1,623 | |
| CaPEBase Model=Gemini 3 pro2026.02 | 76.6 | 5.9 | 50.5 | 1,642 | |
| CaPEBase Model=GPT 5.22026.02 | 76.6 | 5 | 43 | 1,625 | |
| CaPEBase Model=Claude Opus 4.52026.02 | 73.3 | 6.7 | 42.5 | 1,610 | |
| CaPEBase Model=Qwen 2.5 7B2026.02 | 73.3 | 5.8 | 41.6 | 1,832 | |
| CaPEBase Model=Qwen 2.5 72B2026.02 | 73.3 | 6 | 39.1 | 1,593 | |
| CaPEBase Model=Molmo 8B2026.02 | 46.6 | 3.6 | 42.1 | 1,111 | |
| Planner-only2026.02 | 23.3 | 15.1 | 0 | 0 | |
| WaypointBase Model=GPT 5.22026.02 | 20 | 0.5 | 39.6 | 2,677 | |
| WaypointBase Model=Gemini 3.0 pro2026.02 | 16.6 | 0.1 | 95.5 | 3,902 | |
| VLM AgentBase Model=GPT 5.22026.02 | 10 | 0.6 | 56.5 | 2,828 | |
| WaypointBase Model=Claude Opus 4.52026.02 | 10 | 0.2 | 28.7 | 2,771 | |
| RoboPoint2026.02 | 0 | 0 | 32.8 | 2,266 | |
| VLM AgentBase Model=Gemini 3.0 pro2026.02 | 0 | 0 | 44.1 | 3,477 | |
| VLM AgentBase Model=Claude Opus 4.52026.02 | 0 | 0 | 12.7 | 2,807 | |
| VLM AgentBase Model=Molmo 8B2026.02 | 0 | 0 | 32.8 | 2,266 | |
| VLM AgentBase Model=Qwen 72B2026.02 | 0 | 0 | 22 | 2,540 | |
| WaypointBase Model=Molmo 8B2026.02 | 0 | 0 | 10.3 | 2,042 | |
| WaypointBase Model=Qwen 2.5 72B2026.02 | 0 | 0 | 34.5 | 2,383 |