Causal Estimation on Synthetic
100MSAClaude Code Raw
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude Code RawTime (s)=34, Cost ($)=0.1072026.04 | 100 | 10.6 | |
| CAIS Skill (Full)Time (s)=59, Cost ($)=0.2352026.04 | 100 | 4.1 | |
| MAS CompilerTime (s)=115, Cost ($)=0.6082026.04 | 100 | 12.9 | |
| Structured PipelineTime (s)=56, Cost ($)=0.2952026.04 | 100 | 5.5 | |
| Adaptive SkillTime (s)=43, Cost ($)=0.1942026.04 | 100 | 6.3 | |
| Auto Opt.Time (s)=71, Cost ($)=0.233, Stage=Stage 2 result after automatic skill iteration2026.04 | 100 | 6 | |
| Tools OnlyTime (s)=43, Cost ($)=0.1972026.04 | 95.6 | 5.5 | |
| Knowledge OnlyTime (s)=55, Cost ($)=0.3052026.04 | 91.1 | 4.3 | |
| CAIS (MAS)Time (s)=123, Cost ($)=0.0862026.04 | 75.9 | 16.2 |