Tool Calling on F1 Average
91.37Tool Call Name F1Llama3-70B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Llama3-70BModel Series=Llama3.1 Series, Method=HiTEC-KTO2025.05 | 91.37 | 74.48 | |
| Qwen2.5-7BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 90.6 | 73.65 | |
| Llama3.1-70BModel Series=Llama3.1 Series, Method=Baseline2025.05 | 89.54 | 72.67 | |
| Llama3-8BModel Series=Llama3 Series, Method=HiTEC-KTO2025.05 | 89.41 | 69.62 | |
| Llama3-70BModel Series=Llama3 Series, Method=HiTEC-KTO2025.05 | 88.4 | 74.78 | |
| Llama3.1-8BModel Series=Llama3.1 Series, Method=HiTEC-KTO2025.05 | 88.34 | 73.38 | |
| Qwen2.5-3BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 87.87 | 68.54 | |
| Qwen2.5-1.5BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 87.18 | 69.31 | |
| Hammer2-7BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 86.4 | 73.1 | |
| Hammer2-1.5BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 86.37 | 68.98 | |
| Hammer2-3BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 85.24 | 68.44 | |
| Qwen2.5-0.5BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 84.64 | 64.74 | |
| Llama3.1-8BModel Series=Llama3.1 Series, Method=Baseline2025.05 | 83.65 | 64.67 | |
| Llama3-70BModel Series=Llama3 Series, Method=Baseline2025.05 | 73.24 | 70.06 | |
| Hammer2-0.5BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 67.51 | 53.53 | |
| Llama3-8BModel Series=Llama3 Series, Method=Baseline2025.05 | 57.31 | 48.29 |