# Medical Calculation and Tool Use on MedMCP-Calc Special Populations & Universal Tools

Source: [Medical Calculation and Tool Use on MedMCP-Calc Special Populations & Universal Tools](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-special-populations-and-universal-tools>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:38:49.219Z

Evaluation of model performance on the MedMCP-Calc Special Populations & Universal Tools dataset for medical calculation and tool use tasks, measured by metrics like CS, EA, and QP.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Medical Calculation and Tool Use |
| Dataset (including any stated split) | MedMCP-Calc Special Populations & Universal Tools |
| Metric | CS |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 25 of 25 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [CS](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-special-populations-and-universal-tools.md?metric=CS>): Higher is better; unit: SCALAR.

- [EA](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-special-populations-and-universal-tools.md?metric=EA>): Higher is better; unit: SCALAR.

- [QP](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-special-populations-and-universal-tools.md?metric=QP>): Higher is better; unit: SCALAR.

## Recorded results

| Method | CS | Result date | Report paper |
| --- | --- | --- | --- |
| CalcMate-30B | 0.6757 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Claude Sonnet 4.5 | 0.6097 | Not recorded | 69802fd0a8b01e76cc8e17af |
| GLM-4.7 | 0.5743 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Claude Opus 4.5 | 0.5677 | Not recorded | 69802fd0a8b01e76cc8e17af |
| CalcMate-4B | 0.4994 | Not recorded | 69802fd0a8b01e76cc8e17af |
| GPT-5 | 0.4824 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Gemini-3-Pro | 0.4671 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Gemini-2.5-Pro | 0.4664 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Deepseek-V3.1 | 0.4478 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Kimi-K2-Instruct | 0.4185 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B-Instruct-2507 | 0.3941 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B-Thinking-2507 | 0.3837 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B thinking | 0.3371 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-VL-235B | 0.3288 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B non-thinking | 0.3243 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Baichuan-M2-32B | 0.3073 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-Next-80B-Instruct | 0.292 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-30B-Thinking-2507 | 0.2887 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-Next-80B-Thinking | 0.2802 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-4B-Instruct-2507 | 0.2594 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen2.5-72B | 0.2546 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-30B-Instruct-2507 | 0.2459 | Not recorded | 69802fd0a8b01e76cc8e17af |
| MedGemma-27B-IT | 0.2335 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Llama-3.3-70B | 0.1375 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Llama-3.1-70B | 0.1019 | Not recorded | 69802fd0a8b01e76cc8e17af |

### CalcMate-30B

CS: 0.6757. Result ID: 699614445698665ec453bced.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### Claude Sonnet 4.5

CS: 0.6097. Result ID: 699614445698665ec453bcd6.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### GLM-4.7

CS: 0.5743. Result ID: 699614445698665ec453bcda.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a891e209131cea83c41.md>)

Recorded evaluation configuration: {"Parameters":"355 B"}. This record does not assert independent reproduction.

### Claude Opus 4.5

CS: 0.5677. Result ID: 699614445698665ec453bcd5.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### CalcMate-4B

CS: 0.4994. Result ID: 699614445698665ec453bcec.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"4 B"}. This record does not assert independent reproduction.

### GPT-5

CS: 0.4824. Result ID: 699614445698665ec453bcd7.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Gemini-3-Pro

CS: 0.4671. Result ID: 699614445698665ec453bcd8.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro

CS: 0.4664. Result ID: 699614445698665ec453bcd9.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c311e209131cea8cef5.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Deepseek-V3.1

CS: 0.4478. Result ID: 699614445698665ec453bcdb.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"Parameters":"671 B"}. This record does not assert independent reproduction.

### Kimi-K2-Instruct

CS: 0.4185. Result ID: 699614445698665ec453bcde.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a1.md>)

Recorded evaluation configuration: {"Parameters":"1 T"}. This record does not assert independent reproduction.

### Qwen3-235B-Instruct-2507

CS: 0.3941. Result ID: 699614445698665ec453bcdc.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-235B-Thinking-2507

CS: 0.3837. Result ID: 699614445698665ec453bcdd.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-235B thinking

CS: 0.3371. Result ID: 699614445698665ec453bce0.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-VL-235B

CS: 0.3288. Result ID: 699614445698665ec453bce1.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235B"}. This record does not assert independent reproduction.

### Qwen3-235B non-thinking

CS: 0.3243. Result ID: 699614445698665ec453bcdf.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Baichuan-M2-32B

CS: 0.3073. Result ID: 699614445698665ec453bcea.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b041e209131cea863f2.md>)

Recorded evaluation configuration: {"Parameters":"32 B"}. This record does not assert independent reproduction.

### Qwen3-Next-80B-Instruct

CS: 0.292. Result ID: 699614445698665ec453bce2.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"80 B"}. This record does not assert independent reproduction.

### Qwen3-30B-Thinking-2507

CS: 0.2887. Result ID: 699614445698665ec453bce8.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### Qwen3-Next-80B-Thinking

CS: 0.2802. Result ID: 699614445698665ec453bce3.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"80 B"}. This record does not assert independent reproduction.

### Qwen3-4B-Instruct-2507

CS: 0.2594. Result ID: 699614445698665ec453bce9.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"4 B"}. This record does not assert independent reproduction.

### Qwen2.5-72B

CS: 0.2546. Result ID: 699614445698665ec453bce6.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"72 B"}. This record does not assert independent reproduction.

### Qwen3-30B-Instruct-2507

CS: 0.2459. Result ID: 699614445698665ec453bce7.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### MedGemma-27B-IT

CS: 0.2335. Result ID: 699614445698665ec453bceb.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ff1e209131cea808a4.md>)

Recorded evaluation configuration: {"Parameters":"27 B"}. This record does not assert independent reproduction.

### Llama-3.3-70B

CS: 0.1375. Result ID: 699614445698665ec453bce4.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Parameters":"70 B"}. This record does not assert independent reproduction.

### Llama-3.1-70B

CS: 0.1019. Result ID: 699614445698665ec453bce5.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Parameters":"70 B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
