Knowledge Graph Question Answering on ComplexWebQuestions (CWQ) 1.1 (test)
0.723Hit@1RPO-RAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RPO-RAGType=KG + LLM, Backbone=Llama3.1-8B2026.01 | 0.723 | 0.645 | |
| HGNetBackbone=BERT-Base2021.11 | 0.689 | 0.685 | |
| RPO-RAGType=KG + LLM, Backbone=Llama2-7B2026.01 | 0.681 | 0.592 | |
| GNN-RAGType=KG + LLM, Backbone=Llama2-7B2026.01 | 0.668 | 0.594 | |
| GNN-RAGType=KG + LLM, Backbone=Llama3.1-8B, Reproduced=true2026.01 | 0.666 | 0.58 | |
| RPO-RAGType=KG + LLM, Backbone=Llama3.2-3B2026.01 | 0.66 | 0.573 | |
| HGNetBackbone=GloVe + BiLSTM2021.11 | 0.653 | 0.649 | |
| RoGType=KG + LLM, Backbone=Llama2-7B2026.01 | 0.626 | 0.562 | |
| GCRType=KG + LLM, Backbone=Llama3.1-8B, Reproduced=true2026.01 | 0.605 | 0.504 | |
| RPO-RAGType=KG + LLM, Backbone=Llama3.2-1B2026.01 | 0.603 | 0.504 | |
| SubgraphRAGType=KG + LLM, Backbone=Llama3.1-8B2026.01 | 0.57 | 0.472 | |
| UniKGQAType=GNN-based2026.01 | 0.512 | 0.491 | |
| SR + NSMType=GNN-based2026.01 | 0.502 | 0.471 | |
| NSM+h2021.11 | 0.488 | 0.44 | |
| NSMType=GNN-based2026.01 | 0.476 | 0.424 | |
| PullNet2021.11 | 0.459 | — | |
| QGG2021.11 | 0.441 | 0.404 | |
| KBQA-GST2021.11 | 0.393 | 0.365 | |
| GraftNetType=GNN-based2026.01 | 0.368 | 0.327 | |
| HR-BiLSTM2021.11 | 0.333 | 0.312 | |
| GRAFT-Net2021.11 | 0.301 | 0.26 | |
| Llama2-7BType=Vanilla LLM2026.01 | 0.284 | 0.214 | |
| Llama3.1-8BType=Vanilla LLM2026.01 | 0.281 | 0.224 | |
| Llama3.2-3BType=Vanilla LLM2026.01 | 0.199 | 0.144 | |
| Llama3.2-1BType=Vanilla LLM2026.01 | 0.143 | 0.112 | |
| ImprovedQGG2021.11 | — | 0.462 |