Rare disease identification on MIMIC-III (test)
73.3PrecisionSemEHR + SS (anns+BERT)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SemEHR + SS (anns+BERT)Methodology=Strong supervision, BERT Model=BlueBERT-base, Annotations=true2022.05 | 73.3 | 80.5 | 76.7 | |
| SemEHR + WS (rules+BERT)Methodology=Weak supervision, BERT Model=BlueBERT-base, Rules included=true2022.05 | 64.7 | 80.5 | 71.7 | |
| SemEHR + WSrules=true, BlueBERT=true, Weak Supervision=true2021.05 | 63.7 | 78.1 | 70.2 | |
| SemEHR + rulescustomized rules=true2021.05 | 50.9 | 81.5 | 62.6 | |
| SemEHR + rulesRules-based enhancement=true2022.05 | 49 | 86.6 | 62.6 | |
| GHNL API2021.05 | 45.8 | 55.5 | 50.2 | |
| SemEHR2021.05 | 15.7 | 93.8 | 26.9 | |
| SemEHR2022.05 | 13.9 | 92.7 | 24.1 |