List your company
ResearchFormerly WizWand

Tool-use on MCP-Atlas

65.2Pass RateGround Truth Server
-1.536815.789133.11550.4409May 18, 2026May 22, 2026May 27, 2026Jun 1, 2026Jun 5, 2026Jun 10, 2026Jun 15, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Ground Truth ServerSetting=Default2026.0665.271
SINGSetting=Restricted2026.0649.659.5
MCP-ZeroSetting=Restricted2026.0645.456.7
SINGSetting=Global2026.0640.251
MCP-ZeroSetting=Global2026.063447.1
EnvFactoryBackbone=Qwen3-8B, Env. (Data Scale)=85, Tasks (Data Scale)=2,5752026.0513.7525.98
EnvScalerBackbone=Qwen3-4B, Env. (Data Scale)=191, Tasks (Data Scale)=11,5722026.059.9722.27
EnvFactoryBackbone=Qwen3-4B, Env. (Data Scale)=85, Tasks (Data Scale)=2,5752026.059.9721.89
EnvScalerBackbone=Qwen3-8B, Env. (Data Scale)=191, Tasks (Data Scale)=11,5722026.059.6222.63
EnvFactory (SFT)Backbone=Qwen3-8B, Env. (Data Scale)=85, Tasks (Data Scale)=1,6222026.058.2522.86
EnvFactory (SFT)Backbone=Qwen3-4B, Env. (Data Scale)=85, Tasks (Data Scale)=1,6222026.057.919.66
AWMBackbone=Qwen3-8B, Env. (Data Scale)=526, Tasks (Data Scale)=3,3152026.056.1916.6
BaseBackbone=Qwen3-8B, Env. (Data Scale)=–, Tasks (Data Scale)=–2026.055.1514.86
AWMBackbone=Qwen3-4B, Env. (Data Scale)=526, Tasks (Data Scale)=3,3152026.054.4712.33
BaseBackbone=Qwen3-4B, Env. (Data Scale)=–, Tasks (Data Scale)=–2026.054.1212.86
EnvFactoryBackbone=Qwen3-1.7B, Env. (Data Scale)=85, Tasks (Data Scale)=2,5752026.053.099.64
EnvScalerBackbone=Qwen3-1.7B, Env. (Data Scale)=191, Tasks (Data Scale)=11,5722026.052.759.4
EnvFactory (SFT)Backbone=Qwen3-1.7B, Env. (Data Scale)=85, Tasks (Data Scale)=1,6222026.051.7210.05
BaseBackbone=Qwen3-1.7B, Env. (Data Scale)=–, Tasks (Data Scale)=–2026.051.036.25