Tool Calling on Supply Chain Tool Calling 1.0 (test) benchmark leaderboard · SOTA2 Research

Tool Calling on Supply Chain Tool Calling 1.0 (test)

86.73AccuracyGPT-5-mini

Evaluation Results

Method	Links
GPT-5-mini2026.02		86.73
GPT-5-nano2026.02		84.69
GPT-52026.02		84.69
GPT-5-mini2026.02		46.93
Claude-3.7-Sonnet2026.02		40.09
Claude-4-Sonnet2026.02		39.79
Gemini-2.5-Pro2026.02		37.56
GPT-52026.02		35.71
Claude-3.7-Sonnet2026.02		35.71
Claude-4-Opus2026.02		34.69
Deepseek-V32026.02		33.63
Claude-4-Sonnet2026.02		31.63
Claude-3.5-Sonnet2026.02		29.59
GPT-4.1-mini2026.02		28.57
Qwen3-Max2026.02		28.57
Claude-4-Opus2026.02		26.53
GPT-5-nano2026.02		25.51
Gemini-2.5-Flash2026.02		23.46
GPT-4o2026.02		20.4
Deepseek-R12026.02		20.2
Deepseek-R12026.02		17.14
GPT-4o2026.02		16.32
GPT-4.12026.02		16.32
QwQ-32B2026.02		16.32
GPT-O3-mini2026.02		14.28
GPT-4.12026.02		12.24
Kimi-K2-Instruct2026.02		12.24
GPT-4.1-mini2026.02		11.22
Claude-3.5-Sonnet2026.02		11.22
Gemini-2.5-Pro2026.02		11.22
Gemini-2.5-Flash2026.02		10.2
Deepseek-V32026.02		10.2
Kimi-K2-Instruct2026.02		10.2
GPT-O3-mini2026.02		9.18
Qwen3-30B-A3B2026.02		8.16
QwQ-32B2026.02		8.16
Qwen3-Max2026.02		7.14
Qwen3-30B-A3B2026.02		5.1