Tool-calling on BFCL Standard Setting
86.46Non-Live AccuracyAll_Funs
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| All_FunsModel Scale=Qwen2.5-7B-Instruct2026.03 | 86.46 | 67.44 | 76.95 | |
| GT_FunsModel Scale=Qwen2.5-7B-Instruct2026.03 | 85.81 | 78.02 | 81.92 | |
| HiTEC-ICLModel Scale=Qwen2.5-7B-Instruct2026.03 | 84.98 | 76.24 | 80.61 | |
| Tool-DC (TF)Model Scale=Qwen2.5-7B-Instruct2026.03 | 84.73 | 74.83 | 79.78 | |
| Top-KModel Scale=Qwen2.5-7B-Instruct2026.03 | 84.6 | 75.5 | 80.05 | |
| GT_FunsModel Scale=Qwen2.5-3B-Instruct2026.03 | 79.23 | 69.13 | 74.18 | |
| HiTEC-ICLModel Scale=Qwen2.5-3B-Instruct2026.03 | 78.9 | 63.8 | 71.35 | |
| Tool-DC (TF)Model Scale=Qwen2.5-3B-Instruct2026.03 | 78.54 | 66.62 | 72.58 | |
| All_FunsModel Scale=Qwen2.5-3B-Instruct2026.03 | 78.08 | 63.51 | 70.8 | |
| Top-KModel Scale=Qwen2.5-3B-Instruct2026.03 | 78 | 66.03 | 72.02 | |
| ToolGT (Prompting)Model Scale=Qwen2.5-7B-Instruct2026.03 | 77.73 | 68.02 | 72.88 | |
| Tool-DC (TF)Model Scale=Qwen2.5-1.5B-Instruct2026.03 | 77.63 | 63.43 | 70.53 | |
| Top-KModel Scale=Qwen2.5-1.5B-Instruct2026.03 | 76.35 | 63.8 | 70.08 | |
| HiTEC-ICLModel Scale=Qwen2.5-1.5B-Instruct2026.03 | 75.56 | 61.51 | 68.54 | |
| GT_FunsModel Scale=Qwen2.5-1.5B-Instruct2026.03 | 70.96 | 62.77 | 66.87 | |
| All_FunsModel Scale=Qwen2.5-1.5B-Instruct2026.03 | 69.96 | 58.18 | 64.07 | |
| ToolGT (Prompting)Model Scale=Qwen2.5-3B-Instruct2026.03 | 68.94 | 57.22 | 63.08 | |
| ToolGT (Prompting)Model Scale=Qwen2.5-1.5B-Instruct2026.03 | 65.29 | 52.26 | 58.78 |