List your company

Medical Calculation and Tool Use on MedMCP-Calc Overall

100Task Success RateClaude Opus 4.5
78.846484.338289.8395.3218Jan 30, 2026

Evaluation results

MethodLinks
Claude Opus 4.5Parameters=/2026.0110066.6671.0833.92
Claude Sonnet 4.5Parameters=/2026.0110065.653.8627.8
GPT-5Parameters=/2026.0110059.8153.1226.7
Gemini-2.5-ProParameters=/2026.0110055.9640.4520.77
Qwen3-235B-Instruct-2507Parameters=235 B2026.0110041.7434.2410.76
Qwen3-235B-Thinking-2507Parameters=235 B2026.0110038.8226.3311.14
Qwen3-235B non-thinkingParameters=235 B2026.0110031.7338.267.44
Qwen3-235B thinkingParameters=235 B2026.0110033.4230.67.91
Llama-3.3-70BParameters=70 B2026.0110011.622.552.83
Qwen3-30B-Instruct-2507Parameters=30 B2026.0110028.9123.945.95
Qwen3-30B-Thinking-2507Parameters=30 B2026.0110029.7419.237.6
Qwen3-4B-Instruct-2507Parameters=4 B2026.0110019.959.343.08
CalcMate-4BParameters=4 B2026.0110056.9771.0615.02
CalcMate-30BParameters=30 B2026.0110065.6675.3120.07
Deepseek-V3.1Parameters=671 B2026.0199.1544.3341.0412.37
Qwen3-VL-235BParameters=235B2026.0199.1533.7425.679.94
Qwen3-Next-80B-InstructParameters=80 B2026.0199.1538.5721.647.53
Qwen3-Next-80B-ThinkingParameters=80 B2026.0199.1533.334.111.03
Llama-3.1-70BParameters=70 B2026.0199.1511.8719.31.01
Gemini-3-ProParameters=/2026.0197.4654.0555.4526.49
Qwen2.5-72BParameters=72 B2026.0197.4629.3738.497.41
MedGemma-27B-ITParameters=27 B2026.0197.4630.3318.453.61
GLM-4.7Parameters=355 B2026.0196.6151.8950.0615.59
Kimi-K2-InstructParameters=1 T2026.0196.6141.9528.148.27
Baichuan-M2-32BParameters=32 B2026.0179.6633.9533.987.77