zsRE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ZSRE
97.62Generality
393
ZsRE
91.09Efficacy
89
ZsRE
1Reliability
72
zsRE
99.79Efficacy
71
ZsRE
99.74Efficacy
55
ZsRE
99.67Efficacy
46
ZsRE
40.77Efficiency
42
ZsRE T = 300
98.8Efficacy
36
zsRE batch-edit tasks
99Recall
36
ZsRE sequential editing 10,000 Samples
97.8Efficacy Success (Eff)
33
ZsRE 10,000 facts
100Reliability
27
ZsRE
80.5Reliability
26
ZSRE
22.82Accuracy
22
ZSRE sequential editing of 1000 facts
99.7Efficacy
21
ZsRE (evaluation)
99Reliability
21
ZsRE
99.27Efficacy
20
zsRE
57.29Coverage EM
20
ZsRE (test)
0.65Normalized Editing Time
18
ZsRE T = 5000
98.9Efficacy
16
ZSRE
0.975Reliability
16
ZsRE
73.5Reliability
14
ZSRE (test)
99.6Reliability
14
ZsRE 3,000 samples (test)
99.1Relational Score
13
ZsRE N = 10000
1Reliability
12
ZsRE N = 5000
100Reliability
12