Spatial Information on Spatial and Temporal Simulation Tasks Step-level
3.8Subtask AccuracyCortex (full harness)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Cortex (full harness)Level=Step-level2026.07 | 3.8 | 4.254 | 8.053 | |
| Cortex (w/o harness)Level=Step-level2026.07 | 2.994 | 3.933 | 6.927 | |
| Cortex (harness on skills)Level=Step-level2026.07 | 2.885 | 4.15 | 7.035 | |
| Cortex (baseline)Level=Step-level2026.07 | 2.761 | 3.744 | 6.505 | |
| GPT-5Level=Step-level2026.07 | 2.755 | 3.668 | 6.422 | |
| GeminiLevel=Step-level2026.07 | 2.521 | 4.176 | 6.697 | |
| Qwen3-VL-8B-InstructLevel=Step-level2026.07 | 2.162 | 4.263 | 6.424 |