Agent Performance on ACEBench Agent
78Agent ScoreAgentSkiller
Evaluation results
| Method | Links | |
|---|---|---|
| AgentSkillerParameters=14B, Subset=Single-Domain Subset2026.02 | 78 | |
| AgentSkillerParameters=14B, Subset=Full Set (with Cross-Domain Subset)2026.02 | 78 | |
| AgentSkillerParameters=8B, Subset=Single-Domain Subset2026.02 | 76 | |
| EnvScaler-8BParameters=8B, Training=w/ SFT2026.02 | 70 | |
| MUA-14BParameters=14B, Training=w/ SFT2026.02 | 70 | |
| AgentSkillerParameters=8B, Subset=Full Set (with Cross-Domain Subset)2026.02 | 68 | |
| MUA-8BParameters=8B, Training=w/ SFT2026.02 | 66 | |
| Kimi-K2-1T-A32BParameters=1T2026.02 | 65 | |
| EnvScaler-14BParameters=14B, Training=w/ SFT2026.02 | 64 | |
| AgentSkillerParameters=4B, Subset=Single-Domain Subset2026.02 | 64 | |
| Gemini-2.5-pro2026.02 | 63.4 | |
| GPT-o32026.02 | 63.3 | |
| GPT-o4-mini2026.02 | 60 | |
| AgentScaler-30B-A3BParameters=30B2026.02 | 60 | |
| Seed-OSS-36BParameters=36B2026.02 | 58.4 | |
| AgentSkillerParameters=4B, Subset=Full Set (with Cross-Domain Subset)2026.02 | 54 | |
| ToolACE-14BParameters=14B2026.02 | 52 | |
| GPT-OSS-120B-A5BParameters=120B2026.02 | 50.8 | |
| ToolACE-8BParameters=8B2026.02 | 50 | |
| Qwen3-14BParameters=14B2026.02 | 44.2 | |
| AgentScaler-8BParameters=8B2026.02 | 44.2 | |
| Qwen3-Thinking-30B-A3BParameters=30B2026.02 | 42.8 | |
| Claude-Sonnet-42026.02 | 42.5 | |
| Deepseek-V3.1-671B-A37BParameters=671B2026.02 | 40.8 | |
| EnvScaler-4BParameters=4B, Training=w/ SFT2026.02 | 40 | |
| MUA-4BParameters=4B, Training=w/ SFT2026.02 | 40 | |
| Qwen3-Thinking-235B-A22BParameters=235B2026.02 | 39.1 | |
| xLAM-2-70B-fc-rParameters=70B2026.02 | 38.4 | |
| GPT-5-think2026.02 | 32.5 | |
| AgentScaler-4BParameters=4B2026.02 | 30.8 | |
| Qwen3-8BParameters=8B2026.02 | 29.1 | |
| ToolACE-4BParameters=4B2026.02 | 26 | |
| Qwen3-Coder-30B-A3BParameters=30B2026.02 | 24.1 | |
| xLAM-2-32B-fc-rParameters=32B2026.02 | 13.4 | |
| Qwen3-Thinking-4BParameters=4B2026.02 | 11.7 | |
| xLAM-2-8B-fc-rParameters=8B2026.02 | 5 |