# Knowledge Graph Retrieval on PKG Hop 3 Source: [Knowledge Graph Retrieval on PKG Hop 3]() Collection index: [llms.txt]() Data updated: 2026-04-23T07:38:06.867Z Evaluation of model performance on the PKG Hop 3 dataset for Knowledge Graph Retrieval, measured using metrics like QT (ms) and TR (%). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Knowledge Graph Retrieval | | Dataset (including any stated split) | PKG Hop 3 | | Metric | Query Time (ms) | | Unit | TIME | | Direction | Lower is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Query Time (ms)](): Lower is better; unit: TIME. - [TR (%)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Query Time (ms) | Result date | Report paper | | --- | --- | --- | --- | | LogosKG (Torch-GPU) | 43.07 | Not recorded | 69e85bd77d0172140ec81151 | | LogosKG (Numba) | 77.65 | Not recorded | 69e85bd77d0172140ec81151 | | NetworkX | 93.92 | Not recorded | 69e85bd77d0172140ec81151 | | LogosKG (SciPy) | 104.21 | Not recorded | 69e85bd77d0172140ec81151 | | SNAP | 115 | Not recorded | 69e85bd77d0172140ec81151 | | LogosKG (Large-Numba) | 226.83 | Not recorded | 69e85bd77d0172140ec81151 | | GraphBLAS | 291.89 | Not recorded | 69e85bd77d0172140ec81151 | | igraph | 309.9 | Not recorded | 69e85bd77d0172140ec81151 | | LogosKG (Large-SciPy) | 324.95 | Not recorded | 69e85bd77d0172140ec81151 | | PyG | 365.9 | Not recorded | 69e85bd77d0172140ec81151 | | LogosKG (Large-Torch-GPU) | 412.38 | Not recorded | 69e85bd77d0172140ec81151 | | DGL | 1042.25 | Not recorded | 69e85bd77d0172140ec81151 | | cuGraph | 1204 | Not recorded | 69e85bd77d0172140ec81151 | | LogosKG (Torch-CPU) | 1321.05 | Not recorded | 69e85bd77d0172140ec81151 | | graph-tool | 2141.41 | Not recorded | 69e85bd77d0172140ec81151 | | LogosKG (Large-Torch-CPU) | 2551.68 | Not recorded | 69e85bd77d0172140ec81151 | | Neo4j | 5739.02 | Not recorded | 69e85bd77d0172140ec81151 | ### LogosKG (Torch-GPU) Query Time (ms): 43.07. Result ID: 69e9cc4047f34ce924d0a5b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"Torch","Hardware":"GPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### LogosKG (Numba) Query Time (ms): 77.65. Result ID: 69e9cc4047f34ce924d0a5b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"Numba","Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### NetworkX Query Time (ms): 93.92. Result ID: 69e9cc4047f34ce924d0a5ac. [Reporting paper]() Recorded evaluation configuration: {"Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### LogosKG (SciPy) Query Time (ms): 104.21. Result ID: 69e9cc4047f34ce924d0a5b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"SciPy","Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### SNAP Query Time (ms): 115. Result ID: 69e9cc4047f34ce924d0a5af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### LogosKG (Large-Numba) Query Time (ms): 226.83. Result ID: 69e9cc4047f34ce924d0a5b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"Numba","Hardware":"CPU","Scale Variant":"Large"}. This record does not assert independent reproduction. ### GraphBLAS Query Time (ms): 291.89. Result ID: 69e9cc4047f34ce924d0a5b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### igraph Query Time (ms): 309.9. Result ID: 69e9cc4047f34ce924d0a5ad. [Reporting paper]() Recorded evaluation configuration: {"Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### LogosKG (Large-SciPy) Query Time (ms): 324.95. Result ID: 69e9cc4047f34ce924d0a5ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"SciPy","Hardware":"CPU","Scale Variant":"Large"}. This record does not assert independent reproduction. ### PyG Query Time (ms): 365.9. Result ID: 69e9cc4047f34ce924d0a5b4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Hardware":"GPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### LogosKG (Large-Torch-GPU) Query Time (ms): 412.38. Result ID: 69e9cc4047f34ce924d0a5bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"Torch","Hardware":"GPU","Scale Variant":"Large"}. This record does not assert independent reproduction. ### DGL Query Time (ms): 1042.25. Result ID: 69e9cc4047f34ce924d0a5b3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Hardware":"GPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### cuGraph Query Time (ms): 1204. Result ID: 69e9cc4047f34ce924d0a5b2. [Reporting paper]() Recorded evaluation configuration: {"Hardware":"GPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### LogosKG (Torch-CPU) Query Time (ms): 1321.05. Result ID: 69e9cc4047f34ce924d0a5b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"Torch","Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### graph-tool Query Time (ms): 2141.41. Result ID: 69e9cc4047f34ce924d0a5ae. [Reporting paper]() Recorded evaluation configuration: {"Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. ### LogosKG (Large-Torch-CPU) Query Time (ms): 2551.68. Result ID: 69e9cc4047f34ce924d0a5bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backend":"Torch","Hardware":"CPU","Scale Variant":"Large"}. This record does not assert independent reproduction. ### Neo4j Query Time (ms): 5739.02. Result ID: 69e9cc4047f34ce924d0a5b1. [Reporting paper]() Recorded evaluation configuration: {"Hardware":"CPU","Scale Variant":"Standard"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.