Agentic Reasoning and Task Execution on Controlled-domain Coding
0.812Mean Task Rubric Score (G)Offline AW Controller
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Offline AW ControllerPolicy Variant=AW, Seeds=3, Rollouts per task=3, Number of tasks=20, Total trials (N)=1802026.07 | 0.812 | 0.1 | 0.054 | 0.059 | 0.001 | 0.178 | |
| BasePolicy Variant=Base, Seeds=3, Rollouts per task=3, Number of tasks=20, Total trials (N)=1802026.07 | 0.712 | — | — | — | — | — |