# Knowledge Graph Question Answering on MetaQA 3-hop 1.0

Source: [Knowledge Graph Question Answering on MetaQA 3-hop 1.0](<https://www.sota2.com/research/sota/knowledge-graph-question-answering-on-metaqa-3-hop-1-0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-29T07:21:19.771Z

Evaluation of Knowledge Graph Question Answering performance on the MetaQA 3-hop 1.0 dataset, reporting Hit@1 and F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Knowledge Graph Question Answering |
| Dataset (including any stated split) | MetaQA 3-hop 1.0 |
| Metric | Hit@1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Hit@1](<https://www.sota2.com/research/sota/knowledge-graph-question-answering-on-metaqa-3-hop-1-0.md?metric=Hit%401>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/knowledge-graph-question-answering-on-metaqa-3-hop-1-0.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Hit@1 | Result date | Report paper |
| --- | --- | --- | --- |
| OPI-BR | 99.96 | Not recorded | 6a41fbf8206542251d7cca83 |
| OPI-BR | 99.86 | Not recorded | 6a41fbf8206542251d7cca83 |
| UniKGQA | 99.1 | Not recorded | 6a41fbf8206542251d7cca83 |
| NSM | 98.9 | Not recorded | 6a41fbf8206542251d7cca83 |
| KG-GPT | 94 | Not recorded | 6a41fbf8206542251d7cca83 |
| ReasoningLM | 92.7 | Not recorded | 6a41fbf8206542251d7cca83 |
| KG-Agent | 92.1 | Not recorded | 6a41fbf8206542251d7cca83 |
| ARG | 87.7 | Not recorded | 6a41fbf8206542251d7cca83 |
| RDPG | 87.7 | Not recorded | 6a41fbf8206542251d7cca83 |
| StructGPT | 87 | Not recorded | 6a41fbf8206542251d7cca83 |
| R^2 | 85.2 | Not recorded | 6a41fbf8206542251d7cca83 |
| RoG | 84.8 | Not recorded | 6a41fbf8206542251d7cca83 |
| GraftNet | 77.7 | Not recorded | 6a41fbf8206542251d7cca83 |
| Retrieval & Reasoning | 76 | Not recorded | 6a41fbf8206542251d7cca83 |
| BYOKG | 75.7 | Not recorded | 6a41fbf8206542251d7cca83 |
| SymAgent | 57 | Not recorded | 6a41fbf8206542251d7cca83 |
| KV-Mem | 48.9 | Not recorded | 6a41fbf8206542251d7cca83 |

### OPI-BR

Hit@1: 99.96. Result ID: 6a421ce7fbc373592c87387f.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OPI-BR

Hit@1: 99.86. Result ID: 6a421ce7fbc373592c873880.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

Recorded evaluation configuration: {"shot":"one-shot"}. This record does not assert independent reproduction.

### UniKGQA

Hit@1: 99.1. Result ID: 6a421ce7fbc373592c873873.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ea71e209131cea411f3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### NSM

Hit@1: 98.9. Result ID: 6a421ce7fbc373592c873871.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea2356a.md>)

[Implementation](<https://github.com/RichardHGL/WSDM2021_NSM>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### KG-GPT

Hit@1: 94. Result ID: 6a421ce7fbc373592c873876.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ee1e209131cea4e1d2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ReasoningLM

Hit@1: 92.7. Result ID: 6a421ce7fbc373592c873875.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71b51e209131cea52aaf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### KG-Agent

Hit@1: 92.1. Result ID: 6a421ce7fbc373592c87387c.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72391e209131cea55147.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ARG

Hit@1: 87.7. Result ID: 6a421ce7fbc373592c87387a.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770c1e209131cea70b9c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDPG

Hit@1: 87.7. Result ID: 6a421ce7fbc373592c87387d.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### StructGPT

Hit@1: 87. Result ID: 6a421ce7fbc373592c873874.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e44b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### R^2

Hit@1: 85.2. Result ID: 6a421ce7fbc373592c87387e.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RoG

Hit@1: 84.8. Result ID: 6a421ce7fbc373592c873878.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d71.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GraftNet

Hit@1: 77.7. Result ID: 6a421ce7fbc373592c873872.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64c81e209131cea0691f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Retrieval & Reasoning

Hit@1: 76. Result ID: 6a421ce7fbc373592c873877.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BYOKG

Hit@1: 75.7. Result ID: 6a421ce7fbc373592c873879.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73411e209131cea5b4ab.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SymAgent

Hit@1: 57. Result ID: 6a421ce7fbc373592c87387b.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7067d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### KV-Mem

Hit@1: 48.9. Result ID: 6a421ce7fbc373592c873870.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbf8206542251d7cca83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d51e209131ce9fb76c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
