# Medical Calculation and Tool Use on MedMCP-Calc Neurology & Psychiatry

Source: [Medical Calculation and Tool Use on MedMCP-Calc Neurology & Psychiatry](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-neurology-and-psychiatry>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:38:49.189Z

Evaluation of model performance on the MedMCP-Calc Neurology & Psychiatry dataset for medical calculation and tool use tasks, measured by metrics like CS, EA, and QP.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Medical Calculation and Tool Use |
| Dataset (including any stated split) | MedMCP-Calc Neurology & Psychiatry |
| Metric | CS |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 25 of 25 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [CS](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-neurology-and-psychiatry.md?metric=CS>): Higher is better; unit: PERCENT.

- [EA](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-neurology-and-psychiatry.md?metric=EA>): Higher is better; unit: PERCENT.

- [QP Score](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-neurology-and-psychiatry.md?metric=QP%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | CS | Result date | Report paper |
| --- | --- | --- | --- |
| CalcMate-30B | 60.97 | Not recorded | 69802fd0a8b01e76cc8e17af |
| GPT-5 | 60.2 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Claude Opus 4.5 | 60.02 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Claude Sonnet 4.5 | 55.98 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Gemini-2.5-Pro | 50.38 | Not recorded | 69802fd0a8b01e76cc8e17af |
| GLM-4.7 | 49.46 | Not recorded | 69802fd0a8b01e76cc8e17af |
| CalcMate-4B | 49.08 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Gemini-3-Pro | 48.42 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Deepseek-V3.1 | 43.79 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Kimi-K2-Instruct | 38 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Baichuan-M2-32B | 36.02 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B-Instruct-2507 | 34.6 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B-Thinking-2507 | 33.63 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-Next-80B-Thinking | 33.08 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-Next-80B-Instruct | 32.57 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B thinking | 32.25 | Not recorded | 69802fd0a8b01e76cc8e17af |
| MedGemma-27B-IT | 28.85 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B non-thinking | 26.84 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-30B-Thinking-2507 | 22.46 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-VL-235B | 22.45 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-30B-Instruct-2507 | 18.44 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen2.5-72B | 17.75 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Llama-3.1-70B | 16.12 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Llama-3.3-70B | 15.03 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-4B-Instruct-2507 | 12.83 | Not recorded | 69802fd0a8b01e76cc8e17af |

### CalcMate-30B

CS: 60.97. Result ID: 699614445698665ec453bcd4.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### GPT-5

CS: 60.2. Result ID: 699614445698665ec453bcbe.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Claude Opus 4.5

CS: 60.02. Result ID: 699614445698665ec453bcbc.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Claude Sonnet 4.5

CS: 55.98. Result ID: 699614445698665ec453bcbd.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro

CS: 50.38. Result ID: 699614445698665ec453bcc0.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c311e209131cea8cef5.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### GLM-4.7

CS: 49.46. Result ID: 699614445698665ec453bcc1.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a891e209131cea83c41.md>)

Recorded evaluation configuration: {"Parameters":"355 B"}. This record does not assert independent reproduction.

### CalcMate-4B

CS: 49.08. Result ID: 699614445698665ec453bcd3.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"4 B"}. This record does not assert independent reproduction.

### Gemini-3-Pro

CS: 48.42. Result ID: 699614445698665ec453bcbf.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Deepseek-V3.1

CS: 43.79. Result ID: 699614445698665ec453bcc2.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"Parameters":"671 B"}. This record does not assert independent reproduction.

### Kimi-K2-Instruct

CS: 38. Result ID: 699614445698665ec453bcc5.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a1.md>)

Recorded evaluation configuration: {"Parameters":"1 T"}. This record does not assert independent reproduction.

### Baichuan-M2-32B

CS: 36.02. Result ID: 699614445698665ec453bcd1.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b041e209131cea863f2.md>)

Recorded evaluation configuration: {"Parameters":"32 B"}. This record does not assert independent reproduction.

### Qwen3-235B-Instruct-2507

CS: 34.6. Result ID: 699614445698665ec453bcc3.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-235B-Thinking-2507

CS: 33.63. Result ID: 699614445698665ec453bcc4.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-Next-80B-Thinking

CS: 33.08. Result ID: 699614445698665ec453bcca.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"80 B"}. This record does not assert independent reproduction.

### Qwen3-Next-80B-Instruct

CS: 32.57. Result ID: 699614445698665ec453bcc9.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"80 B"}. This record does not assert independent reproduction.

### Qwen3-235B thinking

CS: 32.25. Result ID: 699614445698665ec453bcc7.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### MedGemma-27B-IT

CS: 28.85. Result ID: 699614445698665ec453bcd2.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ff1e209131cea808a4.md>)

Recorded evaluation configuration: {"Parameters":"27 B"}. This record does not assert independent reproduction.

### Qwen3-235B non-thinking

CS: 26.84. Result ID: 699614445698665ec453bcc6.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-30B-Thinking-2507

CS: 22.46. Result ID: 699614445698665ec453bccf.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### Qwen3-VL-235B

CS: 22.45. Result ID: 699614445698665ec453bcc8.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235B"}. This record does not assert independent reproduction.

### Qwen3-30B-Instruct-2507

CS: 18.44. Result ID: 699614445698665ec453bcce.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### Qwen2.5-72B

CS: 17.75. Result ID: 699614445698665ec453bccd.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"72 B"}. This record does not assert independent reproduction.

### Llama-3.1-70B

CS: 16.12. Result ID: 699614445698665ec453bccc.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Parameters":"70 B"}. This record does not assert independent reproduction.

### Llama-3.3-70B

CS: 15.03. Result ID: 699614445698665ec453bccb.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Parameters":"70 B"}. This record does not assert independent reproduction.

### Qwen3-4B-Instruct-2507

CS: 12.83. Result ID: 699614445698665ec453bcd0.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"4 B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
