Tool Use on Single-Calculator
99.62R-F1MedCalc-Pro Agent Framework
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MedCalc-Pro Agent FrameworkModel=gpt-oss-120b2026.07 | 99.62 | 53.56 | 80.15 | |
| MedCalc-Pro Agent FrameworkModel=DeepSeek-V3.12026.07 | 98.53 | 56.19 | 76.04 | |
| MedCalc-Pro Agent FrameworkModel=Qwen3-235B-A22B2026.07 | 98.12 | 52.84 | 79.58 | |
| MedCalc-Pro Agent FrameworkModel=MedResearcher-R1-32B2026.07 | 98.03 | 40.76 | 77 | |
| MedCalc-Pro Agent FrameworkModel=GPT-5-mini2026.07 | 93.13 | 41.19 | 70.13 | |
| MedCalc-Pro Agent FrameworkModel=Llama-3.3-70B-Instruct2026.07 | 86.63 | 37.03 | 65.94 | |
| MedRaCModel=gpt-oss-120b2026.07 | 86.57 | 43.92 | 75.38 | |
| MedRaCModel=Qwen3-235B-A22B2026.07 | 86.57 | 42.35 | 73.85 | |
| MedRaCModel=Llama-3.3-70B-Instruct2026.07 | 86.57 | 34.05 | 69.37 | |
| MedRaCModel=GPT-5-mini2026.07 | 86.57 | 44.7 | 76.72 | |
| MedRaCModel=DeepSeek-V3.12026.07 | 86.57 | 39.05 | 69.08 | |
| MedRaCModel=MedResearcher-R1-32B2026.07 | 86.57 | 40.42 | 64.5 | |
| MeNTiModel=gpt-oss-120b2026.07 | 86.11 | 37.56 | 58.4 | |
| MeNTiModel=MedResearcher-R1-32B2026.07 | 85.51 | 41.25 | 55.73 | |
| MeNTiModel=Llama-3.3-70B-Instruct2026.07 | 84.53 | 38.35 | 58.49 | |
| MeNTiModel=Qwen3-235B-A22B2026.07 | 82.91 | 43.5 | 57.92 | |
| MeNTiModel=GPT-5-mini2026.07 | 82.35 | 45.66 | 56.11 | |
| ReActModel=MedResearcher-R1-32B2026.07 | 80.21 | 40.42 | 56.49 | |
| ReActModel=gpt-oss-120b2026.07 | 79.5 | 48.01 | 55.06 | |
| ReActModel=DeepSeek-V3.12026.07 | 78.03 | 46.65 | 55.06 | |
| ReActModel=GPT-5-mini2026.07 | 77.9 | 35.47 | 49.05 | |
| ReActModel=Qwen3-235B-A22B2026.07 | 75.51 | 39.36 | 51.34 | |
| MeNTiModel=DeepSeek-V3.12026.07 | 73.56 | 39.09 | 49.71 | |
| ReActModel=Llama-3.3-70B-Instruct2026.07 | 72.28 | 23.26 | 40.84 |