Agentic Tool Use on MCP-Bench Single 1.0 benchmark leaderboard · SOTA2 Research

Agentic Tool Use on MCP-Bench Single 1.0

3.54Overall ScoreQwen2.5-4B

Evaluation Results

Method	Links
Qwen2.5-4B2026.06		3.54	2.5	3.9	5.05	5.24	2.9	1.65	3.2	5.14	2.28
Qwen2.5-4B2026.06		3.2	2.07	3.84	4.73	4.95	2.31	1.29	2.96	4.84	1.8
Llama-3.2-3B2026.06		2.29	1.57	2.37	3.57	3.65	1.49	1.06	1.97	3.61	1.27
SmolLM2-3B2026.06		2.03	1.36	2.48	2.59	3.43	1.3	1.02	1.92	3.01	1.16
Qwen2.5-4B2026.06		1.82	1.23	2.04	2.63	2.7	1.44	0.896	1.63	2.67	1.17
Qwen2.5-4B2026.06		1.57	0.952	1.69	2.49	2.52	1.03	0.748	1.32	2.51	0.888
SmolLM2-3B2026.06		1.37	0.887	1.41	1.89	2.36	0.948	0.722	1.15	2.12	0.835
Qwen2.5-4B2026.06		1.28	0.828	1.47	1.68	1.96	0.898	0.872	1.15	1.82	0.885
SmolLM2-3B2026.06		1.28	0.861	1.43	1.88	1.89	0.887	0.713	1.15	1.88	0.8
SmolLM2-3B2026.06		0.997	0.809	1.1	1.34	1.28	0.73	0.722	0.957	1.31	0.726
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.981	0.895	1.37	1.05	1.42	0.867	0.848	1.13	1.23	0.857
Llama-3.2-3B2026.06		0.951	0.704	0.93	1.2	1.5	0.704	0.67	0.817	1.35	0.687
Llama-3.2-3B2026.06		0.912	0.739	0.835	1.22	1.32	0.678	0.678	0.787	1.27	0.678
Llama-3.2-3B2026.06		0.906	0.748	1.24	1.1	0.913	0.765	0.661	0.996	1.01	0.713
Llama-3.2-3B2026.06		0.855	0.652	1.1	0.939	1.17	0.643	0.626	0.874	1.06	0.635
SmolLM2-3B2026.06		0.751	0.652	0.983	0.861	0.791	0.609	0.609	0.817	0.826	0.609
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.68	0.643	0.852	0.626	0.704	0.626	0.626	0.748	0.665	0.626
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.601	0.6	0.733	0.771	0.676	0.59	0.581	0.667	0.724	0.586
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.554	0.548	0.626	0.548	0.539	0.53	0.53	0.587	0.543	0.53
DeepSeek-R1-Distill-Qwen-1.5B2026.06		0.496	0.496	0.496	0.496	0.496	0.496	0.496	0.496	0.496	0.496