Automatic Diagnosis on Muzhi Dataset
72.6Accuracy (w/ Inquiry)MTDiag
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MTDiagLearning Setting=Supervised Learning2024.07 | 72.6 | — | 5 | |
| DiaformerLearning Setting=Supervised Learning2024.07 | 72.2 | — | 5 | |
| HRLLearning Setting=Supervised Learning2024.07 | 67.6 | — | 2.8 | |
| DiagnosisGPTLearning Setting=Zero-shot Setting, Confidence threshold (τ)=0.62024.07 | 65.5 | 62 | 2.4 | |
| Claude-3-OpusLearning Setting=Zero-shot Setting2024.07 | 64.8 | 63.4 | 1.8 | |
| Basic DQNLearning Setting=Supervised Learning2024.07 | 64.1 | — | 2.9 | |
| DiagnosisGPTLearning Setting=Zero-shot Setting, Confidence threshold (τ)=0.52024.07 | 64.1 | 62 | 1.4 | |
| DiagnosisGPTLearning Setting=Zero-shot Setting, Confidence threshold (τ)=0.42024.07 | 62.7 | 62 | 0.6 | |
| Gemini-ProLearning Setting=Zero-shot Setting2024.07 | 60.6 | 63.4 | 0.2 | |
| GPT-4Learning Setting=Zero-shot Setting2024.07 | 57.7 | 59.2 | 0.4 | |
| ERNIE BotLearning Setting=Zero-shot Setting2024.07 | 57 | 61.3 | 0.4 | |
| GPT-3.5Learning Setting=Zero-shot Setting2024.07 | 55.6 | 56.3 | 0.2 | |
| Yi-34B-ChatLearning Setting=Zero-shot Setting2024.07 | 50.7 | 52.1 | 0.4 | |
| Mixtral-8x7B-Instruct-v0.1Learning Setting=Zero-shot Setting2024.07 | 50 | 56.3 | 1.9 |