MQUAKE
Benchmarks
TaskDatasetSOTA resultTrendResults
MQuAKE CF-3K v2
94.7M-A Score
33
MQuAKE
99.95Edit Success Rate
30
MQUAKE
82.5Accuracy
24
MQuAKE-T
99.3M-A Score
22
MQuAKE
64.94Efficiency Score
21
MQuAKE-3K (test)
50.417Overall M-Acc.
16
MQuAKE-3K
99.17Average Performance
16
MQuAKE-T 3-hop
85.4H-Acc
14
MQuAKE-Story 1.0 (test)
100Fact Accuracy (Easy)
14
MQuAKE Story
100Fact Accuracy (Easy)
14
MQuAKE-CF 1.0 (test)
99.9Fact Accuracy (Easy)
14
MQuAKE
92EM
12
MQUAKE-T (All edited)
78.16Accuracy
12
MQUAKE-T (1 edited)
97.7Accuracy
12
MQUAKE-CF-3K (100 edited)
56Accuracy
12
MQUAKE-CF-3K (1 edited)
67.27Accuracy
12
MQuAKE-3K
99.8Efficacy
10
MQuAKE
31.6MHQ Accuracy
10
MQUAKE-CF-3K All edited
45.87Accuracy
10
MQUAKE
0.759Average Accuracy
8
MQuAKE
97.4Efficacy
8
MQUAKE Few-shot
29.16Efficiency
7
MQuAKE-CF (test)
99.22Overall Score
6
MQuAKE CF v2
69.12-hop Score
6
MQUAKE
44.39Average Accuracy
5