Medical Diagnosis on Dynamic Multi-turn Diagnostic Evaluation Chinese
55.31Strict DAPACT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| PACTSize=8B2026.06 | 55.31 | 85.79 | 76.16 | 61.33 | 57.5 | 74.27 | 4.02 | 93.39 | |
| GPT-4.1Size=–2026.06 | 36.7 | 78.82 | 64.86 | 17.26 | 20.4 | 19.76 | 3.85 | 94.04 | |
| Doctor-R1Size=8B2026.06 | 33.5 | 72.09 | 57.8 | 21 | 22.57 | 23.92 | 4.88 | 77 | |
| GPT-5Size=–2026.06 | 33.45 | 64.1 | 54.06 | 12.83 | 14.45 | 13.92 | 5.64 | 79.02 | |
| HuatuoGPT-o1-8BSize=8B2026.06 | 30.54 | 70.61 | 57.26 | 3.21 | 1.54 | 3.36 | 1.72 | 63.88 | |
| Doubao-Seed-1.6Size=–2026.06 | 30.08 | 71.69 | 57.75 | 25.71 | 29.53 | 27.45 | 3.96 | 89.6 | |
| DeepSeek-R1Size=–2026.06 | 29.39 | 72.2 | 56.85 | 19.26 | 20.21 | 22.45 | 3.32 | 87 | |
| Gemini-3.1 ProSize=–2026.06 | 29 | 63.93 | 52.63 | 9.22 | 11.03 | 8.74 | 6.61 | 83.5 | |
| HuatuoGPT2-7BSize=7B2026.06 | 27.85 | 63.64 | 51.24 | 9.99 | 11.71 | 10.47 | 1.8 | 54.39 | |
| UltraMedicalSize=8B2026.06 | 21.77 | 77.71 | 58.67 | 25.7 | 27.56 | 28.07 | 3.73 | 71.27 | |
| DoctorAgent-RLSize=8B2026.06 | 20.36 | 61.43 | 48.74 | 8.25 | 2.01 | 7.53 | 4.36 | 65.65 | |
| Reflect-PubMedSize=8B2026.06 | 14.69 | 51.2 | 39.4 | 10.39 | 2.57 | 10.73 | 2.71 | 67.7 |