Function Calling on ToolBench Average
75.95Pass RateParaTool
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ParaToolBackbone=Qwen2.5-7B-Instruct2026.05 | 75.95 | 80.75 | |
| ParaToolBackbone=Llama3.1-8B-Instruct2026.05 | 69.57 | 71.82 | |
| ToolLLaMABackbone=Qwen2.5-7B-Instruct2026.05 | 68.31 | 70.18 | |
| Parameter+ReinvokeBackbone=Qwen2.5-7B-Instruct2026.05 | 68.28 | 71.28 | |
| Context+Docs & ExamplesBackbone=Qwen2.5-7B-Instruct2026.05 | 66.96 | 69.08 | |
| Context+Docs & ExamplesBackbone=Llama3.1-8B-Instruct2026.05 | 65.67 | 63.58 | |
| ToolLLaMABackbone=Llama3.1-8B-Instruct2026.05 | 65.41 | 65.5 | |
| Parameter+ReinvokeBackbone=Llama3.1-8B-Instruct2026.05 | 63.78 | 65.13 | |
| Claude-3.5-Sonnet + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 60.3 | 72.2 | |
| Parameter+ToolRetrieverBackbone=Qwen2.5-7B-Instruct2026.05 | 60.26 | 62.76 | |
| Parameter+ToolRetrieverBackbone=Llama3.1-8B-Instruct2026.05 | 60.05 | 60.6 | |
| GPT-4o + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 59.2 | 71.4 | |
| Claude-3.5-SonnetFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 58.4 | 70.5 | |
| Context+DocsBackbone=Qwen2.5-7B-Instruct2026.05 | 58.06 | — | |
| GPT-4oFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 57.5 | 69.4 | |
| Parameter+EmbsimBackbone=Qwen2.5-7B-Instruct2026.05 | 57.04 | 61.91 | |
| Parameter+EmbsimBackbone=Llama3.1-8B-Instruct2026.05 | 56.21 | 57.59 | |
| Context+DocsBackbone=Llama3.1-8B-Instruct2026.05 | 56.13 | — | |
| Qwen2.5-72B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 49 | 57.1 | |
| Qwen2.5-72BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 46.9 | 55 | |
| Llama-3.1-70B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 46.4 | 54.4 | |
| Llama-3.1-70BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 44.2 | 52 | |
| Qwen2.5-32B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 42.7 | 50.8 | |
| Qwen2.5-32BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 40.5 | 48.3 | |
| Global ParameterizationBackbone=Qwen2.5-7B-Instruct2026.05 | 39.33 | 38.19 | |
| Global ParameterizationBackbone=Llama3.1-8B-Instruct2026.05 | 35.2 | 32.56 | |
| Qwen2.5-7B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 31.2 | 38 | |
| Llama-3.1-8B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 29.7 | 36.3 | |
| Qwen2.5-7BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 28.7 | 34.9 | |
| Llama-3.1-8BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 27.3 | 33.4 |