Retrieval on Victorian Crime Diaries (VCD)
50Recall@5TCAR-Gen
Evaluation results
| Method | Links | |
|---|---|---|
| TCAR-GenQuery Type=Entity Lookup, Hops=12026.04 | 50 | |
| TCAR-GenQuery Type=Overall, Hops=—2026.04 | 37.38 | |
| TCAR-GenQuery Type=Multi-Hop, Hops=32026.04 | 35 | |
| TCAR-GenQuery Type=Counterfactual, Hops=22026.04 | 35 | |
| TCAR-GenQuery Type=Evidence, Hops=12026.04 | 30 | |
| TCAR-GenQuery Type=Narrative, Hops=12026.04 | 30 | |
| TCAR-GenQuery Type=Temporal, Hops=22026.04 | 26.7 | |
| GraphRAG-CQuery Type=Entity Lookup, Hops=12026.04 | 20 | |
| TCAR-GenQuery Type=Cross-Case, Hops=22026.04 | 20 | |
| GraphRAG-CQuery Type=Narrative, Hops=12026.04 | 16.7 | |
| Vanilla RAGQuery Type=Counterfactual, Hops=22026.04 | 10 | |
| Temporal RAGQuery Type=Counterfactual, Hops=22026.04 | 10 | |
| GraphRAG-TQuery Type=Counterfactual, Hops=22026.04 | 10 | |
| Vanilla RAGQuery Type=Evidence, Hops=12026.04 | 10 | |
| Temporal RAGQuery Type=Evidence, Hops=12026.04 | 10 | |
| GraphRAG-TQuery Type=Evidence, Hops=12026.04 | 10 | |
| GraphRAG-CQuery Type=Temporal, Hops=22026.04 | 10 | |
| Vanilla RAGQuery Type=Cross-Case, Hops=22026.04 | 10 | |
| Temporal RAGQuery Type=Cross-Case, Hops=22026.04 | 10 | |
| GraphRAG-TQuery Type=Cross-Case, Hops=22026.04 | 10 | |
| GraphRAG-CQuery Type=Overall, Hops=—2026.04 | 7.38 | |
| Vanilla RAGQuery Type=Narrative, Hops=12026.04 | 6.7 | |
| Temporal RAGQuery Type=Narrative, Hops=12026.04 | 6.7 | |
| GraphRAG-TQuery Type=Narrative, Hops=12026.04 | 6.7 | |
| Vanilla RAGQuery Type=Overall, Hops=—2026.04 | 5.24 | |
| Temporal RAGQuery Type=Overall, Hops=—2026.04 | 5.24 | |
| GraphRAG-TQuery Type=Overall, Hops=—2026.04 | 5.24 | |
| GraphRAG-CQuery Type=Counterfactual, Hops=22026.04 | 5 | |
| Vanilla RAGQuery Type=Multi-Hop, Hops=32026.04 | 0 | |
| Temporal RAGQuery Type=Multi-Hop, Hops=32026.04 | 0 | |
| GraphRAG-CQuery Type=Multi-Hop, Hops=32026.04 | 0 | |
| GraphRAG-TQuery Type=Multi-Hop, Hops=32026.04 | 0 | |
| Vanilla RAGQuery Type=Entity Lookup, Hops=12026.04 | 0 | |
| Temporal RAGQuery Type=Entity Lookup, Hops=12026.04 | 0 | |
| GraphRAG-TQuery Type=Entity Lookup, Hops=12026.04 | 0 | |
| GraphRAG-CQuery Type=Evidence, Hops=12026.04 | 0 | |
| Vanilla RAGQuery Type=Temporal, Hops=22026.04 | 0 | |
| Temporal RAGQuery Type=Temporal, Hops=22026.04 | 0 | |
| GraphRAG-TQuery Type=Temporal, Hops=22026.04 | 0 | |
| GraphRAG-CQuery Type=Cross-Case, Hops=22026.04 | 0 |