Long-horizon Task on Spatial and Temporal Simulation Tasks Step-level
3.909Subtask AccuracyCortex (full harness)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Cortex (full harness)Level=Step-level2026.07 | 3.909 | 4.25 | 8.16 | |
| Cortex (harness on skills)Level=Step-level2026.07 | 3.144 | 4.121 | 7.265 | |
| Cortex (w/o harness)Level=Step-level2026.07 | 3.112 | 3.952 | 7.064 | |
| Cortex (baseline)Level=Step-level2026.07 | 2.94 | 4.033 | 6.973 | |
| GeminiLevel=Step-level2026.07 | 2.705 | 4.215 | 6.92 | |
| Qwen3-VL-8B-InstructLevel=Step-level2026.07 | 2.611 | 4.165 | 6.775 | |
| GPT-5Level=Step-level2026.07 | 2.481 | 3.682 | 6.163 |