Question Answering on Book Corpus Private (Overall)
89.3AccuracyNWM Graph Retrieval
Evaluation results
| Method | Links | |
|---|---|---|
| NWM Graph RetrievalAnswerer model=Opus 4.8, Extractor model=Sonnet 4.52026.07 | 89.3 | |
| GraphitiAnswerer model=Opus 4.8, Extractor model=Sonnet 4.52026.07 | 49.6 | |
| NWM State MemoryAnswerer model=Opus 4.8, Extractor model=Sonnet 4.52026.07 | 29.4 | |
| GraphRAGAnswerer model=Opus 4.82026.07 | 19.9 | |
| RAG (BGE+BM25+RRF)Answerer model=Opus 4.82026.07 | 18.4 | |
| Simple SearchAnswerer model=Opus 4.82026.07 | 10.7 | |
| No MemoryAnswerer model=Opus 4.82026.07 | 0 |