Text-to-UMLS linking on MIMIC-III unseen in WS n=174 (test)
94.1PrecisionGHNL API
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GHNL APISource=Google Healthcare Natural Language API2021.05 | 94.1 | 89.7 | 91.9 | |
| SemEHR + SSstrong supervision=true, backbone=BlueBERT-base2022.05 | 88.9 | 97.2 | 92.9 | |
| SemEHR + WSweak supervision=true, rules=true, backbone=BlueBERT-base2022.05 | 80.2 | 94.4 | 86.7 | |
| SemEHR + WSComponents=rules + BlueBERT, Supervision=Weak Supervision2021.05 | 78.5 | 95.3 | 86.1 | |
| SemEHRReference recall=100%2021.05 | 61.5 | 100 | 76.1 | |
| SemEHR + rulesEnhancement=Customized rules2021.05 | 61.5 | 100 | 76.1 | |
| SemEHR2022.05 | 61.5 | 100 | 76.2 | |
| SemEHR + rulesrules=true2022.05 | 61.5 | 100 | 76.2 |