List your company

Long-context reasoning and retrieval on LoCoMo (test)

95.12Single-Hop F1TraceMem
30.411247.210664.0180.8094Jan 9, 2026Jan 14, 2026Jan 19, 2026Jan 25, 2026Jan 30, 2026Feb 4, 2026Feb 10, 2026

Evaluation results

MethodLinks
TraceMemBackbone=GPT-4.1-mini2026.0295.12———89.36—90.97—80.21—92.27—
TraceMemBackbone=GPT-4o-mini2026.0293.1———92.2—86.6—70.83—90.19—
FClatency p50=4.18s, latency p90=6.08s, latency p95=6.92s, latency p99=9.35s2026.0192.286.1——82.6—76.6————75
FullTextBackbone=GPT-4.1-mini2026.0292.03———87.23—81.62—66.67—87.4—
EM+SMlatency p50=2.28s, latency p90=3.21s, latency p95=3.68s, latency p99=4.18s2026.018987.7——84.5—90.4————76.1
NemoriBackbone=GPT-4.1-mini2026.0287.04———74.82—76.32—54.17—80.52—
EMlatency p50=2.19s, latency p90=2.94s, latency p95=3.23s, latency p99=3.84s2026.0186.886.3——85.6—87.7————78.1
ReadAgentlatency p50=10.59s, latency p90=15.33s, latency p95=18.00s, latency p99=25.50s2026.0185.779.8——68.8—75.4————75
FullTextBackbone=GPT-4o-mini2026.0283.95———69.86—51.71—58.33—73.05—
NemoriBackbone=GPT-4o-mini2026.0282.52———63.12—68.54—50—74.03—
LightMemBackbone=GPT-4.1-mini2026.0281.21———70.57—78.82—47.92—76.69—
LightMemBackbone=GPT-4o-mini2026.0274.14———60.69—74.22—48.19—70.07—
RAGlatency p50=1.50s, latency p90=2.15s, latency p95=2.40s, latency p99=3.17s2026.017052.6——34.4—29.7————69.2
Mem0latency p50=1.04s, latency p90=1.63s, latency p95=1.81s, latency p99=2.07s2026.0165.759.9——53.1—51.4————69.2
NaiveRAGBackbone=GPT-4.1-mini2026.0262.07———39.01—37.69—47.92—51.88—
A-MemBackbone=GPT-4.1-mini2026.0261.47———56.03—63.55—39.58—59.55—
E-memBackbone=Qwen2.5-14B2026.0161.1457.0446.7552.549.1534.8763.5950.6122.3818.41——
E-memBackbone=GPT-4o-mini2026.0159.2354.1744.3450.5842.6434.3859.8244.5724.8918.15——
NaiveRAGBackbone=GPT-4o-mini2026.0256.6———33.69—30.84—43.75—46.23—
GAMBackbone=Qwen2.5-14B2026.0156.3550.4143.4851.0738.9428.5553.7650.0120.8415.09——
HippoRAGlatency p50=3.51s, latency p90=6.01s, latency p95=7.00s, latency p99=9.72s2026.0155.754.5——21.9—72.9————77.1
RAGBackbone=GPT-4o-mini2026.0152.4544.7339.447.9427.520.1346.0740.3523.2317.94——
MEMORYOSBackbone=GPT-4o-mini2026.0148.6242.8435.5442.9935.2725.2241.1530.7620.0216.52——
A-MemBackbone=GPT-4o-mini2026.0247.92———32.98—38.32—17.71—41.3—
RAGBackbone=Qwen2.5-14B2026.0147.8738.2733.0742.8926.3819.5430.7825.9714.1610.52——
GAMBackbone=GPT-4o-mini2026.0147.7445.3137.7840.934.8427.7253.9143.9326.0319.48——
Mem0Backbone=GPT-4o-mini2026.0147.6545.134.9237.0638.7227.1348.9340.1528.6421.58——
Long-ContextBackbone=GPT-4o-mini2026.0146.6837.3129.5737.5429.2322.7625.9719.4216.8713.7——
MEMORYOSBackbone=Qwen2.5-14B2026.0146.3340.2834.7241.3238.1929.2632.2427.8620.2715.94——
Long-ContextBackbone=Qwen2.5-14B2026.0146.0538.3131.8939.5632.0824.4630.5124.4514.8911.41——
A-memBackbone=GPT-4o-mini2026.0144.6539.6532.3137.0627.0220.0945.8536.6712.1412.01——
A-MEMlatency p50=0.77s, latency p90=1.06s, latency p95=1.25s, latency p99=2.09s2026.0144.337.5——15.6—37.8————53.8
Mem0Backbone=Qwen2.5-14B2026.0142.5836.0429.9135.1531.7324.8228.9626.2415.0311.28——
LIGHTMEMBackbone=GPT-4o-mini2026.0141.7938.4434.3737.8329.7824.943.7139.7216.8913.92——
LIGHTMEMBackbone=Qwen2.5-14B2026.0134.9231.3927.1531.2225.4519.6132.0327.715.8111.81——
A-memBackbone=Qwen2.5-14B2026.0133.7528.9824.4730.0422.0915.2827.1922.0513.4910.74——
Zeplatency p50=1.25s, latency p90=1.65s, latency p95=1.74s, latency p99=2.27s2026.0132.929.6——31.2—5.4————76.9