WebQSP
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WebQSP (30% KB)
73Hits@1
12
WebQSP
93.15Hits@1
10
WebQSP (test)
96.6Triple Recall (1-hop)
9
WebQSP
91.68Hits@1
9
WebQSP
91.5Accuracy
9
WebQSP
91.58Hits@10
8
WebQSP (test)
83.1EM
8
WebQSP 40% knowledge gap
68.33EM
7
WebQSP
9Number of LLM Calls
7
WebQSP multi-entity
85.5F1 Score
7
WebQSP multi-hop
70.3F1 Score
7
WebQSP
2.1Runtime (s)
7
WebQSP
0LLM Calls
6
WebQSP
93.6Hits@1
6
WebQSP (20% knowledge gap)
68EM
5
WebQSP Main entity (test)
80.4Precision
5
WebQSP (test)
85.56Hit Rate
4
WebQSP (test)
88.7Hits@1
3
WebQSP w/o KB
67.7Hits@1
3
WebQSP (hard)
30.4EM
3
WebQSP (test)
2,294Tkg
3
WebQSP
72.5F1 Score
2
WebQSP
80Exact Match (EM)
2
WEBQSP (test)
0.558F1 (All Questions)
2
WEBQSP (dev)
55.4F1 (All Questions)
2