Tool Calling on API-Bank Call
34.7Task Completion RateQwen2.5-7B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-7BSchema configuration=PA-Tool2025.10 | 34.7 | |
| Llama3.1-8BSchema configuration=PA-Tool2025.10 | 29.8 | |
| Qwen2.5-3BSchema configuration=PA-Tool2025.10 | 28.5 | |
| Llama3.1-8BSchema configuration=Base2025.10 | 28 | |
| Qwen2.5-7BSchema configuration=Base2025.10 | 25.7 | |
| Qwen2.5-3BSchema configuration=Base2025.10 | 18 | |
| Llama3.2-3BSchema configuration=PA-Tool2025.10 | 5.4 | |
| Llama3.2-3BSchema configuration=Base2025.10 | 5.1 |