Orchestration Reliability on 100-task controlled benchmark 1.0 (test)
98.8Success RateSelf-healing
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Self-healingTool Calls=2.25, Verifier Calls=1.00, Cost Proxy=3.252026.05 | 98.8 | 27.6 | 0 | |
| Retry-onlyTool Calls=2.24, Verifier Calls=0.00, Cost Proxy=2.242026.05 | 94.5 | 24 | 0 | |
| ReAct-styleTool Calls=2.23, Verifier Calls=0.00, Cost Proxy=3.632026.05 | 94.1 | 22.6 | 0 | |
| Full replanningTool Calls=2.23, Verifier Calls=0.00, Cost Proxy=3.632026.05 | 93.8 | 21 | 0 | |
| Static workflowTool Calls=1.61, Verifier Calls=0.00, Cost Proxy=1.612026.05 | 70.1 | 0 | 0 |