Long-context understanding on Long-document Understanding and Multi-turn Memory Overall
83.8AccuracyHMARS
Evaluation results
| Method | Links | |
|---|---|---|
| HMARSP (Page size)=10242026.06 | 83.8 | |
| Dense RerankN (Rerank candidates)=1002026.06 | 80 | |
| RAGK (Retrieval budget)=20, Retrieval chunk size=1K2026.06 | 78.4 | |
| Dense RerankN (Rerank candidates)=502026.06 | 76.8 | |
| RAGK (Retrieval budget)=50, Retrieval chunk size=1K2026.06 | 76.5 | |
| Full-Context LLM2026.06 | 73 | |
| GraphRAG2026.06 | 70.7 | |
| RAGK (Retrieval budget)=10, Retrieval chunk size=1K2026.06 | 62.2 | |
| RAGK (Retrieval budget)=3, Retrieval chunk size=4K2026.06 | 62.2 | |
| RAGK (Retrieval budget)=5, Retrieval chunk size=4K2026.06 | 61.9 | |
| MemAgent-14BModel parameters=14B2026.06 | 27 | |
| CoA-7BModel parameters=7B2026.06 | 19.6 |