Question Answering on Book Corpus 96 single-hop questions Private (Control)
88.5AccuracyNWM Graph Retrieval
Evaluation results
| Method | Links | |
|---|---|---|
| NWM Graph RetrievalAnswerer model=Opus 4.8, Extractor model=Sonnet 4.52026.07 | 88.5 | |
| GraphitiAnswerer model=Opus 4.8, Extractor model=Sonnet 4.52026.07 | 35.4 | |
| GraphRAGAnswerer model=Opus 4.82026.07 | 21.9 | |
| RAG (BGE+BM25+RRF)Answerer model=Opus 4.82026.07 | 19.8 | |
| NWM State MemoryAnswerer model=Opus 4.8, Extractor model=Sonnet 4.52026.07 | 17.7 | |
| Simple SearchAnswerer model=Opus 4.82026.07 | 14.6 | |
| No MemoryAnswerer model=Opus 4.82026.07 | 0 |