Tool Selection on EnterpriseArena
45Tool Selection AccuracyGemini-2.5 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-2.5 ProModel Category=Closed-Source Models, Evaluation Protocol=2-shot2026.03 | 45 | |
| Claude-3.5-SonnetModel Category=Closed-Source Models, Evaluation Protocol=2-shot2026.03 | 43 | |
| GPT-4oModel Category=Closed-Source Models, Evaluation Protocol=2-shot2026.03 | 31 | |
| Qwen3-8B Agentic GRPOModel Category=Our Platform-Trained Models (<1K), Training Setting=Agentic GRPO2026.03 | 28 | |
| Qwen3-8B SFTModel Category=Our Platform-Trained Models (<1K), Training Setting=Supervised Fine-Tuning2026.03 | 20 | |
| ToolAceModel Category=Open-Source Models, Training Setting=26K-trained2026.03 | 15 | |
| Qwen3-8B BaseModel Category=Open-Source Models, Evaluation Protocol=2-shot2026.03 | 14 | |
| xLAM-2-70BModel Category=Open-Source Models, Training Setting=60K-trained2026.03 | 10 |