Locomo
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
LoCoMo
0.09Storage Size (GiB)
6
LoCoMo
82.9Macro-AUC
6
LoCoMo FULL v363 (test)
80.8R@10
6
LoCoMo
75.2Hit@1
6
LoCoMo-P13n
39.8Good Rating
6
LoCoMo (full run)
99.4R@60
6
LoCoMo
73.9Average Score
6
LoCoMo 2024
75.39Single Hop Accuracy
6
LoCoMo
69.54Accuracy
6
LoCoMo 98 QA probes
2.18Score (1-5)
6
LoCoMo
0Retrieval Latency P50 (ms)
6
LoCoMo
87.7Accuracy
6
LOCOMO (test)
89Answer Accuracy
6
LoCoMo N=225 (test)
41.7Precision
6
LoCoMo loc 2024
38Construction Time (s)
6
LoCoMo
6.7Execution Time (min)
6
LoCoMo
44.6L Score
6
LoCoMo turn-level (test)
26.5F1 Score
6
LoCoMo
511.25Memory (tokens)
6
LoCoMo
56.1BLEU-1
6
LOCOMO locomo_time
51.39F1 Score
6
LOCOMO locomo_multi
29.53F1 Score
6
LoCoMo
44.94F1 Score
6
LoCOMO
64.5MH
5
LoCoMo Large-Scale (N=50)
24.03BLEU-1
5