Tool Calling on Nexus Raven
94.84Score (Name)Llama3-70B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Llama3-70BModel Series=Llama3.1 Series, Method=HiTEC-KTO2025.05 | 94.84 | 82.87 | — | — | — | |
| Llama3.1-70BModel Series=Llama3.1 Series, Method=Baseline2025.05 | 93.75 | 82.72 | — | — | — | |
| Llama3-70BModel Series=Llama3 Series, Method=HiTEC-KTO2025.05 | 91.85 | 81.92 | — | — | — | |
| Qwen2.5-7BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 91.7 | 78.17 | — | — | — | |
| Hammer2-7BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 90.76 | 80.96 | — | — | — | |
| Llama3.1-8BModel Series=Llama3.1 Series, Method=HiTEC-KTO2025.05 | 89.98 | 82.28 | — | — | — | |
| Hammer2-3BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 89.14 | 66.71 | — | — | — | |
| Llama3.1-8BModel Series=Llama3.1 Series, Method=Baseline2025.05 | 87.93 | 72.17 | — | — | — | |
| Qwen2.5-1.5BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 86.37 | 64.4 | — | — | — | |
| Hammer2-1.5BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 85.85 | 63.76 | — | — | — | |
| Qwen2.5-3BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 83.05 | 62.35 | — | — | — | |
| Qwen2.5-0.5BModel Series=Qwen2.5 Series, Method=HiTEC-KTO2025.05 | 82.83 | 63.89 | — | — | — | |
| Llama3-8BModel Series=Llama3 Series, Method=HiTEC-KTO2025.05 | 78.17 | 64.6 | — | — | — | |
| Llama3-70BModel Series=Llama3 Series, Method=Baseline2025.05 | 75.43 | 73.25 | — | — | — | |
| Hammer2-0.5BModel Series=Qwen2.5 Series, Method=Baseline2025.05 | 64.72 | 45.52 | — | — | — | |
| Llama3-8BModel Series=Llama3 Series, Method=Baseline2025.05 | 14.83 | 17.44 | — | — | — | |
| CoTBackbone=GPT-4-Turbo2025.05 | — | — | 92.18 | 85 | — | |
| CoTBackbone=Llama3-8B2025.05 | — | — | 64.44 | 52.22 | — | |
| CoTBackbone=Llama3.1-8B2025.05 | — | — | 76.71 | 67.32 | — | |
| Hammer-1.5BModel Size=1.5B2026.04 | — | — | — | — | 56.88 | |
| Hammer-7BModel Size=7B2026.04 | — | — | — | — | 74.64 | |
| HiTEC-ICLModel=GPT-4-Turbo2025.05 | — | — | 92.81 | 83.15 | — | |
| HiTEC-ICLModel=Llama3.1-70B2025.05 | — | — | 94.54 | 83.44 | — | |
| HiTEC-ICLBackbone=GPT-4-Turbo2025.05 | — | — | 92.81 | 83.15 | — | |
| HiTEC-ICLBackbone=Llama3-8B2025.05 | — | — | 82.07 | 58.3 | — | |
| HiTEC-ICLBackbone=Llama3.1-8B2025.05 | — | — | 87.76 | 72.35 | — | |
| HiTEC-KTOModel=Llama3.1-70B2025.05 | — | — | 94.84 | 82.87 | — | |
| HiTEC-KTOModel=Qwen2.5-7B2025.05 | — | — | 91.7 | 78.17 | — | |
| Qwen2.5-1.5BModel Size=1.5B2026.04 | — | — | — | — | 49.88 | |
| Qwen2.5-32BModel Size=32B2026.04 | — | — | — | — | 82.66 | |
| Qwen2.5-7BModel Size=7B2026.04 | — | — | — | — | 72.83 | |
| two-step training model (AugFC)Model Size=1.5B2026.04 | — | — | — | — | 78.4 | |
| two-step training model (AugFC)Model Size=7B2026.04 | — | — | — | — | 89.01 | |
| two-step training model (AugFC)Model Size=32B2026.04 | — | — | — | — | 86.82 | |
| VanillaBackbone=GPT-4-Turbo2025.05 | — | — | 94.13 | 82.92 | — | |
| VanillaBackbone=Llama3-8B2025.05 | — | — | 14.83 | 17.44 | — | |
| VanillaBackbone=Llama3.1-8B2025.05 | — | — | 87.93 | 72.17 | — | |
| xLAM-1.3B-fcModel Size=1.5B2026.04 | — | — | — | — | 54.8 | |
| xLAM-2-32B-fcModel Size=32B2026.04 | — | — | — | — | 85.73 | |
| xLAM-7B-fcModel Size=7B2026.04 | — | — | — | — | 54.09 |