# Medical Calculation and Tool Use on MedMCP-Calc Critical Care & Perioperative Medicine

Source: [Medical Calculation and Tool Use on MedMCP-Calc Critical Care & Perioperative Medicine](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-critical-care-and-perioperative-medicine>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:38:49.169Z

Evaluation of model performance on the MedMCP-Calc Critical Care & Perioperative Medicine dataset for medical calculation and tool use tasks, measured by metrics like CS, EA, and QP.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Medical Calculation and Tool Use |
| Dataset (including any stated split) | MedMCP-Calc Critical Care & Perioperative Medicine |
| Metric | CS |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 25 of 25 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [CS](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-critical-care-and-perioperative-medicine.md?metric=CS>): Higher is better; unit: PERCENT.

- [EA](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-critical-care-and-perioperative-medicine.md?metric=EA>): Higher is better; unit: PERCENT.

- [QP](<https://www.sota2.com/research/sota/medical-calculation-and-tool-use-on-medmcp-calc-critical-care-and-perioperative-medicine.md?metric=QP>): Higher is better; unit: SCALAR.

## Recorded results

| Method | CS | Result date | Report paper |
| --- | --- | --- | --- |
| CalcMate-4B | 73.9 | Not recorded | 69802fd0a8b01e76cc8e17af |
| CalcMate-30B | 73.6 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Claude Opus 4.5 | 71.3 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Claude Sonnet 4.5 | 69.55 | Not recorded | 69802fd0a8b01e76cc8e17af |
| GPT-5 | 61.87 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Gemini-2.5-Pro | 59.61 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Gemini-3-Pro | 57.59 | Not recorded | 69802fd0a8b01e76cc8e17af |
| GLM-4.7 | 50.86 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B-Instruct-2507 | 48.83 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Deepseek-V3.1 | 41.85 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Kimi-K2-Instruct | 40.54 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-Next-80B-Instruct | 39.89 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B-Thinking-2507 | 39.74 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-Next-80B-Thinking | 35.79 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-30B-Thinking-2507 | 34.21 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-VL-235B | 32.69 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B non-thinking | 32.34 | Not recorded | 69802fd0a8b01e76cc8e17af |
| MedGemma-27B-IT | 31.75 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-235B thinking | 30.94 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-30B-Instruct-2507 | 29.99 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen2.5-72B | 29.93 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Baichuan-M2-32B | 29.79 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Qwen3-4B-Instruct-2507 | 20.7 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Llama-3.1-70B | 9.22 | Not recorded | 69802fd0a8b01e76cc8e17af |
| Llama-3.3-70B | 8.04 | Not recorded | 69802fd0a8b01e76cc8e17af |

### CalcMate-4B

CS: 73.9. Result ID: 699614445698665ec453bca1.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"4 B"}. This record does not assert independent reproduction.

### CalcMate-30B

CS: 73.6. Result ID: 699614445698665ec453bca2.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### Claude Opus 4.5

CS: 71.3. Result ID: 699614445698665ec453bc8a.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Claude Sonnet 4.5

CS: 69.55. Result ID: 699614445698665ec453bc8b.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### GPT-5

CS: 61.87. Result ID: 699614445698665ec453bc8c.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro

CS: 59.61. Result ID: 699614445698665ec453bc8e.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c311e209131cea8cef5.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### Gemini-3-Pro

CS: 57.59. Result ID: 699614445698665ec453bc8d.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"/"}. This record does not assert independent reproduction.

### GLM-4.7

CS: 50.86. Result ID: 699614445698665ec453bc8f.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a891e209131cea83c41.md>)

Recorded evaluation configuration: {"Parameters":"355 B"}. This record does not assert independent reproduction.

### Qwen3-235B-Instruct-2507

CS: 48.83. Result ID: 699614445698665ec453bc91.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Deepseek-V3.1

CS: 41.85. Result ID: 699614445698665ec453bc90.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"Parameters":"671 B"}. This record does not assert independent reproduction.

### Kimi-K2-Instruct

CS: 40.54. Result ID: 699614445698665ec453bc93.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a1.md>)

Recorded evaluation configuration: {"Parameters":"1 T"}. This record does not assert independent reproduction.

### Qwen3-Next-80B-Instruct

CS: 39.89. Result ID: 699614445698665ec453bc97.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"80 B"}. This record does not assert independent reproduction.

### Qwen3-235B-Thinking-2507

CS: 39.74. Result ID: 699614445698665ec453bc92.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-Next-80B-Thinking

CS: 35.79. Result ID: 699614445698665ec453bc98.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"80 B"}. This record does not assert independent reproduction.

### Qwen3-30B-Thinking-2507

CS: 34.21. Result ID: 699614445698665ec453bc9d.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### Qwen3-VL-235B

CS: 32.69. Result ID: 699614445698665ec453bc96.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235B"}. This record does not assert independent reproduction.

### Qwen3-235B non-thinking

CS: 32.34. Result ID: 699614445698665ec453bc94.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### MedGemma-27B-IT

CS: 31.75. Result ID: 699614445698665ec453bca0.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ff1e209131cea808a4.md>)

Recorded evaluation configuration: {"Parameters":"27 B"}. This record does not assert independent reproduction.

### Qwen3-235B thinking

CS: 30.94. Result ID: 699614445698665ec453bc95.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"235 B"}. This record does not assert independent reproduction.

### Qwen3-30B-Instruct-2507

CS: 29.99. Result ID: 699614445698665ec453bc9c.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"30 B"}. This record does not assert independent reproduction.

### Qwen2.5-72B

CS: 29.93. Result ID: 699614445698665ec453bc9b.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

Recorded evaluation configuration: {"Parameters":"72 B"}. This record does not assert independent reproduction.

### Baichuan-M2-32B

CS: 29.79. Result ID: 699614445698665ec453bc9f.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b041e209131cea863f2.md>)

Recorded evaluation configuration: {"Parameters":"32 B"}. This record does not assert independent reproduction.

### Qwen3-4B-Instruct-2507

CS: 20.7. Result ID: 699614445698665ec453bc9e.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Parameters":"4 B"}. This record does not assert independent reproduction.

### Llama-3.1-70B

CS: 9.22. Result ID: 699614445698665ec453bc9a.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Parameters":"70 B"}. This record does not assert independent reproduction.

### Llama-3.3-70B

CS: 8.04. Result ID: 699614445698665ec453bc99.

[Reporting paper](<https://www.sota2.com/research/paper/69802fd0a8b01e76cc8e17af.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Parameters":"70 B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
