Tool Retrieval and Calling on API-Bank Call+Retrieve
26.9Task Completion RateQwen2.5-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-7BSchema configuration=PA-Tool2025.10 | 26.9 | |
| Qwen2.5-7BSchema configuration=Base2025.10 | 23.5 | |
| Llama3.1-8BSchema configuration=PA-Tool2025.10 | 22.4 | |
| Qwen2.5-3BSchema configuration=PA-Tool2025.10 | 21.9 | |
| Llama3.1-8BSchema configuration=Base2025.10 | 21 | |
| Qwen2.5-3BSchema configuration=Base2025.10 | 18.5 | |
| Llama3.2-3BSchema configuration=Base2025.10 | 10.9 | |
| Llama3.2-3BSchema configuration=PA-Tool2025.10 | 9.2 |