Medical Knowledge Evaluation on Medical Knowledge Item Bank Full 2815 items
2.25Thetao1
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| o1evaluation_protocol=Full item bank2026.02 | 2.25 | 90.69 | 2,262,040 | 21,948.43 | |
| gemini-proevaluation_protocol=Full item bank2026.02 | 2.24 | 90.66 | 4,199,151 | 43,261.89 | |
| gemini-2.5-proevaluation_protocol=Full item bank2026.02 | 2.17 | 90.05 | 4,150,473 | 41,674.9 | |
| deepseek-r1evaluation_protocol=Full item bank2026.02 | 2 | 88.41 | 4,623,837 | 127,313.89 | |
| claude-4-sonnet-thinkingevaluation_protocol=Full item bank2026.02 | 1.91 | 87.46 | 2,012,822 | 47,918.66 | |
| gemini-2.5-flashevaluation_protocol=Full item bank2026.02 | 1.91 | 87.35 | 3,786,735 | 23,407.74 | |
| gpt-oss-120bevaluation_protocol=Full item bank2026.02 | 1.82 | 86.32 | 1,624,119 | 26,510.19 | |
| minimax-m1evaluation_protocol=Full item bank2026.02 | 1.75 | 85.58 | 7,131,754 | 316,596.65 | |
| gpt-4oevaluation_protocol=Full item bank2026.02 | 1.75 | 85.47 | 726,135 | 2,664.2 | |
| glm-4.5-airevaluation_protocol=Full item bank2026.02 | 1.73 | 85.33 | 5,246,139 | 112,054.24 | |
| qwen3-30b-a3bevaluation_protocol=Full item bank2026.02 | 1.56 | 82.91 | 6,190,960 | 48,662.88 | |
| o1-minievaluation_protocol=Full item bank2026.02 | 1.53 | 82.63 | 2,010,210 | 11,702.52 | |
| kimi-k2evaluation_protocol=Full item bank2026.02 | 1.5 | 82.24 | 777,343 | 6,241.36 | |
| gemini-2.0-flashevaluation_protocol=Full item bank2026.02 | 1.49 | 81.99 | 755,259 | 2,555.54 | |
| gpt-oss-20bevaluation_protocol=Full item bank2026.02 | 1.33 | 79.57 | 1,868,072 | 9,763.62 | |
| gpt-4evaluation_protocol=Full item bank2026.02 | 1.29 | 78.72 | 734,656 | 6,520.99 | |
| glm-3-turboevaluation_protocol=Full item bank2026.02 | 0.99 | 73.18 | 740,403 | 2,842.69 | |
| yi-lightningevaluation_protocol=Full item bank2026.02 | 0.98 | 72.93 | 861,252 | 3,906.47 | |
| yi-sparkevaluation_protocol=Full item bank2026.02 | 0.98 | 72.86 | 861,252 | 3,763.33 | |
| qwen2.5-72b-instructevaluation_protocol=Full item bank2026.02 | 0.97 | 72.82 | 756,202 | 2,008.9 | |
| qwen-maxevaluation_protocol=Full item bank2026.02 | 0.97 | 72.82 | 756,063 | 1,233.18 | |
| yi-mediumevaluation_protocol=Full item bank2026.02 | 0.93 | 72.18 | 861,252 | 4,138.59 |