List your company

Knowledge-Update Question Answering on LongMemEval (n=45 specific questions)

29Correct CountBaseline (BM25 + LLM-freshness)
25.8826.6927.528.31May 31, 2026

Evaluation results

MethodLinks
Baseline (BM25 + LLM-freshness)Pipeline=BM25 + LLM-freshness, Backbone=gpt-4o-mini, Freshness Signal=LLM-based2026.052964.449.8
Deterministic pipeline (BM25 + extract + Python max(timestamp))Pipeline=BM25 + extract + Python max(timestamp), Backbone=gpt-4o-mini, Freshness Signal=max(timestamp)2026.052657.843.3