Nested-calculator calculation on MedCalc-Pro 1.0 (test) benchmark leaderboard · SOTA2 Research

Nested-calculator calculation on MedCalc-Pro 1.0 (test)

87.22R-F1MedCalc-Pro Agent Framework

Evaluation Results

Method	Links
MedCalc-Pro Agent Framework2026.07		87.22	93.5	88.48	75.8	87.1
ReAct2026.07		80.62	83.87	66.42	11.74	77.41
MedCalc-Pro Agent Framework2026.07		80	93.5	88.91	83.9	85.5
MedCalc-Pro Agent Framework2026.07		78.26	87.1	81.05	75.81	80.65
ReAct2026.07		77.78	90.3	72.01	25.8	82.3
ReAct2026.07		74.02	75.81	58.45	19.35	56.45
ReAct2026.07		67.2	67.74	49.95	24.19	27.42
MedCalc-Pro Agent Framework2026.07		61.54	64.52	57.27	56.45	91.94
MedCalc-Pro Agent Framework2026.07		58.73	59.68	52.53	51.61	56.45
ReAct2026.07		55.76	71	25.19	11.29	12.9
MedCalc-Pro Agent Framework2026.07		55.03	58.66	67.21	71.67	80.33
ReAct2026.07		53.23	51.61	38.11	20.97	24.19
MeNTi2026.07		42.86	11.29	40.15	35.43	19.35
MeNTi2026.07		37.96	54.84	59.53	45.16	58.06
MeNTi2026.07		36.52	56.45	61.68	61.29	54.83
MeNTi2026.07		34.19	48.39	53.28	51.61	45.16
MeNTi2026.07		31.78	66.13	56.08	54.83	53.22
MeNTi2026.07		21.12	33.9	15.5	16.12	11.29
MedRaC2026.07		0	0	0	0	0
MedRaC2026.07		0	0	0	0	0
MedRaC2026.07		0	0	0	0	0
MedRaC2026.07		0	0	0	0	0
MedRaC2026.07		0	0	0	0	0
MedRaC2026.07		0	0	0	0	0