Medical Knowledge Evaluation on Medical Knowledge Item Bank Full 2815 items benchmark leaderboard · SOTA2 Research

Medical Knowledge Evaluation on Medical Knowledge Item Bank Full 2815 items

2.25Thetao1

Evaluation Results

Method	Links
o12026.02		2.25	90.69	2,262,040	21,948.43
gemini-pro2026.02		2.24	90.66	4,199,151	43,261.89
gemini-2.5-pro2026.02		2.17	90.05	4,150,473	41,674.9
deepseek-r12026.02		2	88.41	4,623,837	127,313.89
claude-4-sonnet-thinking2026.02		1.91	87.46	2,012,822	47,918.66
gemini-2.5-flash2026.02		1.91	87.35	3,786,735	23,407.74
gpt-oss-120b2026.02		1.82	86.32	1,624,119	26,510.19
minimax-m12026.02		1.75	85.58	7,131,754	316,596.65
gpt-4o2026.02		1.75	85.47	726,135	2,664.2
glm-4.5-air2026.02		1.73	85.33	5,246,139	112,054.24
qwen3-30b-a3b2026.02		1.56	82.91	6,190,960	48,662.88
o1-mini2026.02		1.53	82.63	2,010,210	11,702.52
kimi-k22026.02		1.5	82.24	777,343	6,241.36
gemini-2.0-flash2026.02		1.49	81.99	755,259	2,555.54
gpt-oss-20b2026.02		1.33	79.57	1,868,072	9,763.62
gpt-42026.02		1.29	78.72	734,656	6,520.99
glm-3-turbo2026.02		0.99	73.18	740,403	2,842.69
yi-lightning2026.02		0.98	72.93	861,252	3,906.47
yi-spark2026.02		0.98	72.86	861,252	3,763.33
qwen2.5-72b-instruct2026.02		0.97	72.82	756,202	2,008.9
qwen-max2026.02		0.97	72.82	756,063	1,233.18
yi-medium2026.02		0.93	72.18	861,252	4,138.59