UMLS
Benchmarks
TaskDatasetSOTA resultTrendResults
UMLS
100Hits@10
56
UMLS
0.995Hits@10
29
UMLS
94.55Accuracy
18
UMLS (test)
83.48MRR
17
UMLS (test)
0.867MRR
17
UMLS (test)
99.8Hits@10
17
UMLS (test)
96.92Accuracy
9
UMLS
94MRR
9
UMLS
0.762MRR
8
UMLS manual concept sets M
98Recall
5
UMLS
0.6Running Time (min)
4
UMLS (val)
77.2MRR
4
UMLS relation probing (Overall)
3.26Recall@5
4
UMLS relation probing (Type 1)
14.01Recall@5
4
UMLS Five Target Concepts Definitive class (test)
71Macro Recall
3