Computer-Using Agent Task on WebArena shopping_admin 12-task subset (Cold) (Run 1)
7.25Success RatePreAct gate-ON + cache-miss CUA fallback
Evaluation results
| Method | Links | |
|---|---|---|
| PreAct gate-ON + cache-miss CUA fallbackn_reps=4, backbone=Claude Sonnet 4.62026.06 | 7.25 | |
| Muscle-Memcache_type=blind linear cache, n_reps=4, backbone=Claude Sonnet 4.62026.06 | 7 | |
| Workflow-Usescripts=per-task, n_reps=4, backbone=Claude Sonnet 4.62026.06 | 7 | |
| PreAct gate-ONverify_gate=enabled, n_reps=4, backbone=Claude Sonnet 4.62026.06 | 6 | |
| PreAct gate-OFFverify_gate=disabled, n_reps=4, backbone=Claude Sonnet 4.62026.06 | 5.75 |