MetaQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MetaQA 3-hop
100Hits@1
47
MetaQA 3-hop
93.4Accuracy
39
MetaQA 2-hop
95.9Accuracy
39
MetaQA 1-hop
82.77Accuracy
30
MetaQA
92.71-hop EM@1
30
MetaQA 1hop
100Hits@1
28
MetaQA 2-hop
100Hits@1
28
MetaQA 2-hop (test)
100Hits@1
24
MetaQA 3-hop
98.9Accuracy
22
MetaQA 3-hop 1.0
99.96Hit@1
17
MetaQA 1-hop
87.6Accuracy
16
MetaQA 1hop (Qwen2.5-7B)
85.28AUC
14
MetaQA 2-hop 1.0
99.99Hit@1
12
MetaQA 1-hop 1.0
100Hit@1
12
MetaQA
100Hit@1 (2-hop)
11
MetaQA 3-hop
0.86Normalized Latency (vs Vanilla RAG)
9
MetaQA 2-hop
0.83Normalized Average Latency
9
MetaQA 1-hop
0.8Average Latency (Normalized)
9
MetaQA 3-hop
2.1Average Edge Budget
9
MetaQA 2-hop
0.78Average Edge Budget
9
MetaQA 1-hop
97.5Hits@1
9
MetaQA 2-hop 1.0 (test)
94.4Accuracy
9
MetaQA 1-hop 1.0 (test)
97.5Accuracy (%)
9
MetaQA 50% KG setting (test)
76Hits@1 (1-hop)
9
MetaQA
99.9Hits@1
8