Data Annotation and Generation on Agent Benchmarking Frameworks
10Typical StepsOSWorld
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OSWorld2025.06 | 10 | 4.4 | 8.8 | |
| τ-bench2025.06 | 20 | 2 | 4 | |
| TheAgentCompany2025.06 | 30 | 17 | 34 | |
| AgentSynth2025.06 | 40 | — | 0.6 |
Loading the SOTA2 catalog…