List your company
ResearchFormerly WizWand

Tool Calling on Supply Chain Tool Calling 1.0 (test)

86.73AccuracyGPT-5-mini
1.834823.874945.91567.9551Feb 7, 2026
Updated 8mo ago

Evaluation results

MethodLinks
GPT-5-miniSOP setting=w/ SOP2026.0286.73
GPT-5-nanoSOP setting=w/ SOP2026.0284.69
GPT-5SOP setting=w/ SOP2026.0284.69
GPT-5-miniSOP setting=w/o SOP2026.0246.93
Claude-3.7-SonnetSOP setting=w/ SOP2026.0240.09
Claude-4-SonnetSOP setting=w/ SOP2026.0239.79
Gemini-2.5-ProSOP setting=w/ SOP2026.0237.56
GPT-5SOP setting=w/o SOP2026.0235.71
Claude-3.7-SonnetSOP setting=w/o SOP2026.0235.71
Claude-4-OpusSOP setting=w/ SOP2026.0234.69
Deepseek-V3SOP setting=w/ SOP2026.0233.63
Claude-4-SonnetSOP setting=w/o SOP2026.0231.63
Claude-3.5-SonnetSOP setting=w/ SOP2026.0229.59
GPT-4.1-miniSOP setting=w/ SOP2026.0228.57
Qwen3-MaxSOP setting=w/ SOP2026.0228.57
Claude-4-OpusSOP setting=w/o SOP2026.0226.53
GPT-5-nanoSOP setting=w/o SOP2026.0225.51
Gemini-2.5-FlashSOP setting=w/ SOP2026.0223.46
GPT-4oSOP setting=w/o SOP2026.0220.4
Deepseek-R1SOP setting=w/ SOP2026.0220.2
Deepseek-R1SOP setting=w/o SOP2026.0217.14
GPT-4oSOP setting=w/ SOP2026.0216.32
GPT-4.1SOP setting=w/ SOP2026.0216.32
QwQ-32BSOP setting=w/ SOP2026.0216.32
GPT-O3-miniSOP setting=w/ SOP2026.0214.28
GPT-4.1SOP setting=w/o SOP2026.0212.24
Kimi-K2-InstructSOP setting=w/o SOP2026.0212.24
GPT-4.1-miniSOP setting=w/o SOP2026.0211.22
Claude-3.5-SonnetSOP setting=w/o SOP2026.0211.22
Gemini-2.5-ProSOP setting=w/o SOP2026.0211.22
Gemini-2.5-FlashSOP setting=w/o SOP2026.0210.2
Deepseek-V3SOP setting=w/o SOP2026.0210.2
Kimi-K2-InstructSOP setting=w/ SOP2026.0210.2
GPT-O3-miniSOP setting=w/o SOP2026.029.18
Qwen3-30B-A3BSOP setting=w/ SOP2026.028.16
QwQ-32BSOP setting=w/o SOP2026.028.16
Qwen3-MaxSOP setting=w/o SOP2026.027.14
Qwen3-30B-A3BSOP setting=w/o SOP2026.025.1