Long-context Question Answering on LongMemEval 1.0 (test)
49CSMEPC
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EPCAggregation=3-reader avg, Budget=5K2026.05 | 49 | 42 | 4 | 7 | |
| Summ. (L)Aggregation=3-reader avg, Budget=5K, Summary Type=LLM2026.05 | 44 | 38 | 9 | 6 | |
| ReadAg.Aggregation=3-reader avg, Budget=5K2026.05 | 43 | 35 | 10 | 8 | |
| MemWlk.Aggregation=3-reader avg, Budget=5K2026.05 | 35 | 27 | 18 | 8 | |
| MemBankAggregation=3-reader avg, Budget=5K2026.05 | 30 | 25 | 23 | 5 | |
| Summ. (E)Aggregation=3-reader avg, Budget=5K, Summary Type=Extractive2026.05 | 26 | 22 | 27 | 4 | |
| VerbatimAggregation=3-reader avg, Budget=5K2026.05 | 22 | 18 | 31 | 4 |