Text-to-UMLS on MIMIC-III Radiology n=53+/198 (External val)
89.4PrecisionSemEHR + SS (transfer)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SemEHR + SS (transfer)Supervision=Strong, Configuration=Transfer2022.05 | 89.4 | 79.2 | 84 | |
| SemEHR + WS (+ tuning F1)Supervision=Weak, p=0.0005, l=4, Tuning=Best F12022.05 | 89.1 | 92.5 | 90.7 | |
| SemEHR + rules (tuned)p=0.0005, l=4, Operation=OR2022.05 | 87.5 | 92.5 | 89.9 | |
| SemEHR + WS (+ tuning R)Supervision=Weak, p=0.01, l=4, Tuning=Best Recall2022.05 | 81.5 | 100 | 89.8 | |
| SemEHR + WS (in-domain)Supervision=Weak, Configuration=In-domain2022.05 | 72.9 | 96.2 | 82.9 | |
| SemEHR + WS (transfer)Supervision=Weak, Configuration=Transfer2022.05 | 54.4 | 92.5 | 68.5 | |
| SemEHRBaseline=true2022.05 | 26.7 | 100 | 42.2 |