Multi-label Classification of SDoH ICD-9 V-codes on MIMIC-III v1.4 (139 admissions subset)
0.722Exact Match ScoreGPT-5-mini
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-5-miniParameters=Unknown, Prompting=Few-shot2025.12 | 0.722 | 0.939 | 0.847 | 0.882 | 0.939 | 0.847 | 0.891 | 0.797 | 0.608 | 0.665 | |
| GPT-4o-miniParameters=Unknown, Prompting=Few-shot2025.12 | 0.691 | 0.864 | 0.87 | 0.855 | 0.845 | 0.87 | 0.857 | 0.719 | 0.642 | 0.645 | |
| Qwen3Parameters=32B, Prompting=Few-shot2025.12 | 0.655 | 0.918 | 0.77 | 0.829 | 0.925 | 0.77 | 0.84 | 0.769 | 0.577 | 0.644 | |
| GPT-OSSParameters=20B, Prompting=Few-shot2025.12 | 0.652 | 0.896 | 0.775 | 0.824 | 0.952 | 0.775 | 0.854 | 0.795 | 0.58 | 0.652 | |
| Llama-3.3Parameters=70B, Prompting=Few-shot2025.12 | 0.355 | 0.765 | 0.85 | 0.74 | 0.598 | 0.85 | 0.702 | 0.678 | 0.663 | 0.573 | |
| GPT-3.5-turboParameters=Unknown, Prompting=Few-shot2025.12 | 0.144 | 0.718 | 0.338 | 0.452 | 0.529 | 0.338 | 0.413 | 0.208 | 0.162 | 0.167 | |
| Llama-3.1Parameters=8B, Prompting=Few-shot2025.12 | 0.103 | 0.527 | 0.765 | 0.573 | 0.412 | 0.765 | 0.536 | 0.383 | 0.521 | 0.351 |