Agent Execution on EnterpriseArena (test)
71Execution AccuracyGemini-2.5 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-2.5 ProPrompting=2-shot2026.03 | 71 | |
| Claude-3.5-SonnetPrompting=2-shot2026.03 | 60 | |
| GPT-4oPrompting=2-shot2026.03 | 45 | |
| Qwen3-8B Agentic GRPOTraining Strategy=Agentic GRPO, Training Data=<1K2026.03 | 43 | |
| ToolAceTraining Data=26K-trained2026.03 | 39 | |
| Qwen3-8B SFTTraining Strategy=SFT, Training Data=<1K2026.03 | 35 | |
| Qwen3-8B BasePrompting=2-shot2026.03 | 31 | |
| xLAM-2-70BTraining Data=60K-trained2026.03 | 15 |