Tool Calling on Nexus Raven v1 (test)
94.84F1 NameHiTEC-KTO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HiTEC-KTOModel Series=Llama3.1 Series, Model=Llama3-70B2025.05 | 94.84 | 82.87 | |
| BaselineModel Series=Llama3.1 Series, Model=Llama3.1-70B2025.05 | 93.75 | 82.72 | |
| HiTEC-KTOModel Series=Qwen2.5 Series, Model=Qwen2.5-7B2025.05 | 91.7 | 78.17 | |
| BaselineModel Series=Qwen2.5 Series, Model=Hammer2-7B2025.05 | 90.76 | 80.96 | |
| HiTEC-KTOModel Series=Llama3.1 Series, Model=Llama3.1-8B2025.05 | 89.98 | 82.28 | |
| BaselineModel Series=Qwen2.5 Series, Model=Hammer2-3B2025.05 | 89.14 | 66.71 | |
| BaselineModel Series=Llama3.1 Series, Model=Llama3.1-8B2025.05 | 87.93 | 72.17 | |
| HiTEC-KTOModel Series=Qwen2.5 Series, Model=Qwen2.5-1.5B2025.05 | 86.37 | 64.4 | |
| BaselineModel Series=Qwen2.5 Series, Model=Hammer2-1.5B2025.05 | 85.85 | 63.76 | |
| HiTEC-KTOModel Series=Qwen2.5 Series, Model=Qwen2.5-3B2025.05 | 83.05 | 62.35 | |
| HiTEC-KTOModel Series=Qwen2.5 Series, Model=Qwen2.5-0.5B2025.05 | 82.83 | 63.89 | |
| BaselineModel Series=Qwen2.5 Series, Model=Hammer2-0.5B2025.05 | 64.72 | 45.52 |