Tool Use on Extended BFCL Single
61.54File AccuracyClaude-Sonnet-4.5
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude-Sonnet-4.5Tool-use Adaptation (TA)=true2026.04 | 61.54 | 52.63 | 85 | 84.62 | |
| Claude-Sonnet-4.5Tool-use Adaptation (TA)=false2026.04 | 53.85 | 52.63 | 85 | 84.62 | |
| DeepSeek-ChatTool-use Adaptation (TA)=false2026.04 | 53.85 | 15.79 | 55 | 61.54 | |
| DeepSeek-ChatTool-use Adaptation (TA)=true2026.04 | 46.15 | 5.26 | 70 | 30.77 | |
| xLAM-2-8B-FCTool-use Adaptation (TA)=true2026.04 | 46.15 | 26.32 | 50 | 69.23 | |
| GPT-4oTool-use Adaptation (TA)=false2026.04 | 38.46 | 47.37 | 90 | 92.31 | |
| GPT-4oTool-use Adaptation (TA)=true2026.04 | 38.46 | 47.37 | 95 | 100 | |
| xLAM-2-8B-FCTool-use Adaptation (TA)=false2026.04 | 38.46 | 31.58 | 50 | 53.85 | |
| ToolACE-2-8BTool-use Adaptation (TA)=true2026.04 | 30.77 | 21.05 | 65 | 46.15 | |
| Qwen3-8BTool-use Adaptation (TA)=false2026.04 | 23.08 | 10.53 | 65 | 23.08 | |
| Qwen3-8BTool-use Adaptation (TA)=true2026.04 | 23.08 | 21.05 | 65 | 30.77 | |
| ToolACE-2-8BTool-use Adaptation (TA)=false2026.04 | 15.38 | 21.05 | 45 | 46.15 |