# Knowledge Base Question Answering on CWQ 50% KB

Source: [Knowledge Base Question Answering on CWQ 50% KB](<https://www.sota2.com/research/sota/knowledge-base-question-answering-on-cwq-50-percent-kb>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-08T09:24:23.238Z

Evaluation of Knowledge Base Question Answering performance on the 50% KB subset of the Complex WebQuestions (CWQ) dataset, reporting Hits@1.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Knowledge Base Question Answering |
| Dataset (including any stated split) | CWQ 50% KB |
| Metric | Hits@1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 12 of 12 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Hits@1](<https://www.sota2.com/research/sota/knowledge-base-question-answering-on-cwq-50-percent-kb.md?metric=Hits%401>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Hits@1 | Result date | Report paper |
| --- | --- | --- | --- |
| JCQL | 50.8 | Not recorded | 69d5e13a7d0172140ec75c5f |
| GoG | 47.7 | Not recorded | 69d5e13a7d0172140ec75c5f |
| PDRR | 47.1 | Not recorded | 69d5e13a7d0172140ec75c5f |
| JCQL | 46.9 | Not recorded | 69d5e13a7d0172140ec75c5f |
| JCQL | 42.7 | Not recorded | 69d5e13a7d0172140ec75c5f |
| PoG | 42.3 | Not recorded | 69d5e13a7d0172140ec75c5f |
| LMP | 40.1 | Not recorded | 69d5e13a7d0172140ec75c5f |
| ToG | 32.8 | Not recorded | 69d5e13a7d0172140ec75c5f |
| DECAFAns | 31.2 | Not recorded | 69d5e13a7d0172140ec75c5f |
| KGT5 | 26.1 | Not recorded | 69d5e13a7d0172140ec75c5f |
| BiNet | 20.8 | Not recorded | 69d5e13a7d0172140ec75c5f |
| KG-CoT | 16.5 | Not recorded | 69d5e13a7d0172140ec75c5f |

### JCQL

Hits@1: 50.8. Result ID: 69d61eb547f34ce924befa20.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### GoG

Hits@1: 47.7. Result ID: 69d61eb547f34ce924befa1a.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75121e209131cea657ed.md>)

Recorded evaluation configuration: {"Venue":"EMNLP’24"}. This record does not assert independent reproduction.

### PDRR

Hits@1: 47.1. Result ID: 69d61eb547f34ce924befa1d.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c40.md>)

Recorded evaluation configuration: {"Venue":"AAAI’26"}. This record does not assert independent reproduction.

### JCQL

Hits@1: 46.9. Result ID: 69d61eb547f34ce924befa1f.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

Recorded evaluation configuration: {"LLM":"LLaMA3.1-70B"}. This record does not assert independent reproduction.

### JCQL

Hits@1: 42.7. Result ID: 69d61eb547f34ce924befa1e.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

Recorded evaluation configuration: {"LLM":"Qwen3-30B-A3B"}. This record does not assert independent reproduction.

### PoG

Hits@1: 42.3. Result ID: 69d61eb547f34ce924befa1b.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75741e209131cea68054.md>)

[Implementation](<https://github.com/liyichen-cly/PoG>)

Recorded evaluation configuration: {"Venue":"NeurIPS’24"}. This record does not assert independent reproduction.

### LMP

Hits@1: 40.1. Result ID: 69d61eb547f34ce924befa1c.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

Recorded evaluation configuration: {"Venue":"ACL’25"}. This record does not assert independent reproduction.

### ToG

Hits@1: 32.8. Result ID: 69d61eb547f34ce924befa19.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72a21e209131cea57b26.md>)

Recorded evaluation configuration: {"Venue":"ICLR’24"}. This record does not assert independent reproduction.

### DECAFAns

Hits@1: 31.2. Result ID: 69d61eb547f34ce924befa15.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f131e209131cea43bb5.md>)

Recorded evaluation configuration: {"Venue":"ICLR’23"}. This record does not assert independent reproduction.

### KGT5

Hits@1: 26.1. Result ID: 69d61eb547f34ce924befa16.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32008.md>)

[Implementation](<https://github.com/apoorvumang/kgt5>)

Recorded evaluation configuration: {"Venue":"ACL’22"}. This record does not assert independent reproduction.

### BiNet

Hits@1: 20.8. Result ID: 69d61eb547f34ce924befa17.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

Recorded evaluation configuration: {"Venue":"SIGKDD’22"}. This record does not assert independent reproduction.

### KG-CoT

Hits@1: 16.5. Result ID: 69d61eb547f34ce924befa18.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e13a7d0172140ec75c5f.md>)

Recorded evaluation configuration: {"Venue":"IJCAI’24"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
