PersonaMem
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
PersonaMem 128K context length
70Query-Answering Accuracy
60
PersonaMem 32K context length
90Query-Answering Accuracy
60
PersonaMem 1M context length
72Query-Answering Accuracy
38
PersonaMem 1.0
76.06Overall Score
33
PersonaMem v1.0 (test)
74.53Overall Score
28
PersonaMem
37.19Exact Match (EM)
24
PersonaMem (Average)
72Accuracy
22
PersonaMem 128K
23.75F1 Score
20
PersonaMem 32K
26.45F1 Score
20
PersonaMem v2 (test)
0.945F1 Score
18
PersonaMem
64.36Accuracy
16
PersonaMem 32k v2
59.3Accuracy
12
PersonaMem 32k
77.59Accuracy
12
PersonaMem
88.64Recall Facts
12
PersonaMem
77.03Accuracy
12
PersonaMem
69.7Preference Recall
11
PersonaMem v2
47.97Accuracy
8
PersonaMem 128K context scale
47.24Accuracy
8
PersonaMem 32K context scale
57.06Accuracy
8
PERSONAMEM 32k context
57.93Accuracy
8
PersonaMem
58.9Precision
8
PersonaMem v1
52.74R-Fact Score
7
PersonaMem v2
0.34Storage Size (GiB)
6
PersonaMem 128k
63.87Accuracy
5
PersonaMem
65.2Normalized Score
5