Automatic Diagnosis on Muzhi-2
65Disease AccuracyBERT full
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BERT fulllimited turns=202023.07 | 65 | — | — | — | |
| CoAD w/o dlimited turns=202023.07 | 65 | 0.67 | 0.66 | 16.9 | |
| CoAD*limited turns=202023.07 | 65 | 0.68 | 0.66 | 13.8 | |
| Diaformerlimited turns=202023.07 | 64 | 0.61 | 0.63 | 11.5 | |
| CoAD w/o slimited turns=202023.07 | 64 | 0.67 | 0.65 | 16.2 | |
| CoADMax Turns=152023.07 | 64 | 62 | 0.64 | 15 | |
| GPT-2 dislimited turns=202023.07 | 63 | 0.62 | 0.62 | 16.2 | |
| CoAD_w/o dMax Turns=152023.07 | 63 | 63 | 0.64 | 15 | |
| CoAD_w/o sMax Turns=152023.07 | 63 | 62 | 0.63 | 14.7 | |
| DiaformerMax Turns=102023.07 | 62 | 58 | 0.59 | 9.8 | |
| CoAD_w/o dMax Turns=102023.07 | 62 | 51 | 0.56 | 10 | |
| CoADMax Turns=102023.07 | 62 | 58 | 0.6 | 9.9 | |
| PPOMax Turns=152023.07 | 62 | 12 | 0.21 | 3.5 | |
| DiaformerMax Turns=152023.07 | 62 | 64 | 0.62 | 12.4 | |
| PPOMax Turns=102023.07 | 61 | 15 | 0.24 | 3.5 | |
| DiaformerMax Turns=52023.07 | 60 | 39 | 0.47 | 4.9 | |
| CoADMax Turns=52023.07 | 60 | 39 | 0.47 | 5 | |
| GPT-2disMax Turns=102023.07 | 60 | 50 | 0.54 | 10 | |
| CoAD_w/o sMax Turns=102023.07 | 60 | 51 | 0.56 | 9.8 | |
| GPT-2disMax Turns=152023.07 | 60 | 58 | 0.59 | 15 | |
| PPOlimited turns=202023.07 | 59 | 0.18 | 0.28 | 6.6 | |
| PPOMax Turns=52023.07 | 58 | 14 | 0.22 | 3.2 | |
| CoAD_w/o dMax Turns=52023.07 | 58 | 38 | 0.42 | 5 | |
| CoAD_w/o sMax Turns=52023.07 | 58 | 34 | 0.43 | 5 | |
| GPT-2disMax Turns=52023.07 | 57 | 33 | 0.42 | 5 |