Function Calling on ToolBench I1-Inst
57.1Pass RateClaude-3.5-Sonnet + TAFC
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude-3.5-Sonnet + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 57.1 | 64.3 | |
| GPT-4o + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 56.3 | 63.5 | |
| Claude-3.5-SonnetFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 55.4 | 62.7 | |
| GPT-4oFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 54.8 | 61.2 | |
| Qwen2.5-72B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 48.7 | 56.1 | |
| Qwen2.5-72BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 47.1 | 54.3 | |
| Llama-3.1-70B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 46.3 | 53.4 | |
| Llama-3.1-70BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 44.7 | 51.5 | |
| Qwen2.5-32B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 43.1 | 50.8 | |
| Qwen2.5-32BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 41.2 | 48.6 | |
| Qwen2.5-7B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 31.9 | 39.4 | |
| Llama-3.1-8B + TAFCFramework=TAFC, Temperature=0.1, Independent Runs=32026.01 | 30.8 | 37.9 | |
| Qwen2.5-7BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 29.6 | 36.2 | |
| Llama-3.1-8BFramework=Standard FC, Temperature=0.1, Independent Runs=32026.01 | 28.5 | 35.1 |