Agentic Tool Use on MCP-Bench 3-server 1.0 benchmark leaderboard · SOTA2 Research

Agentic Tool Use on MCP-Bench 3-server 1.0

3.95Overall ScoreQwen2.5-4B

Evaluation Results

Method	Links
Qwen2.5-4B2026.06		3.95	3.48	4.5	5.1	5.15	3.8	1.7	3.99	5.12	2.75
Qwen2.5-4B2026.06		3.2	2.2	4.4	3.88	5.3	2.02	1.4	3.3	4.59	1.71
SmolLM2-3B2026.06		1.85	1.34	1.66	2.04	3.68	1.14	1.24	1.5	2.86	1.19
Llama-3.2-3B2026.06		1.45	1.32	1.57	1.68	1.9	1.12	1.1	1.45	1.79	1.11
Qwen2.5-4B2026.06		1.42	0.9	1.55	2.17	2.38	0.775	0.725	1.23	2.27	0.75
Qwen2.5-4B2026.06		1.36	1.15	0.975	2.07	2.09	0.969	0.919	1.06	2.08	0.944
DeepSeek-R1-Distill-Qwen-1.5B2026.06		1.18	1.15	1.7	1.05	1.05	1.05	1.05	1.43	1.05	1.05
Llama-3.2-3B2026.06		1.06	0.7	0.85	2.15	1.3	0.7	0.675	0.775	1.73	0.688
SmolLM2-3B2026.06		1.03	0.875	1.45	0.825	1.4	0.825	0.8	1.16	1.11	0.812
Llama-3.2-3B2026.06		1.01	0.825	1	1.52	1.18	0.8	0.725	0.912	1.35	0.762
SmolLM2-3B2026.06		0.958	0.85	0.75	1.12	1.52	0.75	0.75	0.8	1.32	0.75
SmolLM2-3B2026.06		0.883	0.75	0.675	0.775	1.72	0.7	0.675	0.713	1.25	0.688
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.725	0.725	0.725	0.725	0.725	0.725	0.725	0.725	0.725	0.725
Llama-3.2-3B2026.06		0.683	0.6	0.6	1.07	0.6	0.625	0.6	0.6	0.838	0.613
Qwen2.5-4B2026.06		0.683	0.55	0.425	1.27	0.9	0.475	0.475	0.488	1.09	0.475
Llama-3.2-3B2026.06		0.662	0.625	0.75	0.8	0.7	0.55	0.55	0.688	0.75	0.55
SmolLM2-3B2026.06		0.654	0.488	0.488	0.644	1.33	0.488	0.488	0.488	0.988	0.488
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.575	0.575	0.575	0.575	0.575	0.575	0.575	0.575	0.575	0.575
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.554	0.575	0.55	0.55	0.55	0.55	0.55	0.562	0.55	0.55
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.337	0.35	0.35	0.325	0.325	0.35	0.325	0.35	0.325	0.338