WD50K
Benchmarks
TaskDatasetSOTA resultTrendResults
WD50K
0.759MRR
22
WD50K
0.419MRR
15
WD50K
60.4Accuracy
13
WD50K
50.8Accuracy
13
WD50K all entities
0.554MRR
8
WD50K subject object
39.5MRR
8
WD50K
0.968MRR
6
WD50K-NFOL n-ary (test)
36.87Avg P Score
6
WD50K triple version (10% labeled)
98.4ROC AUC
6
WD50K triple (5% labeled)
98.4ROC-AUC
6
WD50K standard 13.6% qualifier ratio
0.349MRR
5
WD50K 100% facts with qualifiers
69.5MRR
5
WD50K 66% facts with qualifiers
51.1MRR
5
WD50K 33% facts with qualifiers
33.6MRR
5
WD50K-QE n-ary (test)
75.84AvgP
4
WD50K
0.927MRR
4
WD50K
91.6MRR
4