Agent Evaluation Dataset (20 agents x 2 requirement types)
0.68Time (min)LLM-Singleturn
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLM-SingleturnLLM=Haiku 4.52026.05 | 0.68 | 50.26 | |
| LLM-SingleturnLLM=Sonnet 4.52026.05 | 1.36 | 49.99 | |
| EvalAgentLLM=Haiku 4.52026.05 | 3.98 | 2,872.07 | |
| Agent-SourcecodeLLM=Sonnet 4.52026.05 | 4.03 | 869.36 | |
| EvalAgentLLM=Sonnet 4.52026.05 | 4.18 | 2,094.98 | |
| Agent-OnestageLLM=Sonnet 4.52026.05 | 4.39 | 1,698.44 | |
| Agent-SourcecodeLLM=Haiku 4.52026.05 | 4.54 | 2,196.16 | |
| Agent-OnestageLLM=Haiku 4.52026.05 | 5.3 | 3,579.46 | |
| Agent-TwostageLLM=Haiku 4.52026.05 | 6.72 | 4,049.63 | |
| Agent-TwostageLLM=Sonnet 4.52026.05 | 10 | 3,023.59 |