WN18RR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WN18RR (test)
98.5Hits@10
390
WN18RR
78.6Hits@10
238
WN18RR (test)
49.6MRR
194
WN18RR filtered (test)
54Hits@10
57
WN18RR 10 way Lexical KG (test)
40.02Accuracy
30
WN18RR 5 way Lexical KG (test)
68.05Accuracy
30
WN18RR transductive (test)
0.579MRR
30
WN18RR inductive (test)
0.737MRR
30
WN18RR v1 (test)
0.742MRR
24
WN18RR
93.52Accuracy
22
WN18RR
67MRR
19
WN18RR V4
0.89Hits@10
19
WN18RR V3
89.5Hits@10
19
WN18RR V2
0.905Hits@10
19
WN18RR standard (transductive)
57.2MRR
14
WN18RR inductive v4
94.19Hits@10
14
WN18RR inductive v3
89.3Hits@10
14
WN18RR inductive v2
94.56Hits@10
14
WN18RR inductive v1
96.28Hits@10
14
WN18RR inductive v1
94.9Hits@10
13
WN18RR V1
0.948Hits@10
13
WN18RR+ 30% ratio Multi-label edges (train)
74.99Micro-F1
12
WN18RR originally reported recent (test)
0.497MRR
12
WN18RR (test)
99.5Accuracy
12
WN18RR transductive (test)
67.8Hit@10
9