# MCTS-KBQA: Monte Carlo Tree Search for Knowledge Base Question Answering

Source: [MCTS-KBQA: Monte Carlo Tree Search for Knowledge Base Question Answering](<https://www.sota2.com/research/paper/68fa770e1e209131cea70d3e>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T04:08:58.245Z

Authors: Guanming Xiong, Haochen Li, Wen Zhao

Published: 2025-02-19T04:58:39.000Z

## Abstract

This study explores how to enhance the reasoning capabilities of large language models (LLMs) in knowledge base question answering (KBQA) by leveraging Monte Carlo Tree Search (MCTS). Semantic parsing-based KBQA methods are particularly challenging as these approaches require locating elements from knowledge bases and generating logical forms, demanding not only extensive annotated data but also strong reasoning capabilities. Although recent approaches leveraging LLMs as agents have demonstrated considerable potential, these studies are inherently constrained by their linear decision-making processes. To address this limitation, we propose a MCTS-based framework that enhances LLMs' reasoning capabilities through tree search methodology. We design a carefully designed step-wise reward mechanism that requires only direct prompting of open-source instruction LLMs without additional fine-tuning. Experimental results demonstrate that our approach significantly outperforms linear decision-making methods, particularly in low-resource scenarios. Additionally, we contribute new data resources to the KBQA community by annotating intermediate reasoning processes for existing question-SPARQL datasets using distant supervision. Experimental results on the extended dataset demonstrate that our method achieves comparable performance to fully supervised models while using significantly less training data.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Knowledge Base Question Answering on WebQSP (test)](<https://www.sota2.com/research/sota/knowledge-base-question-answering-on-webqsp-test.md>): Knowledge Base Question Answering; WEBQSP (test); Hit@1: not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2502.13428>)

[PDF](<https://arxiv.org/pdf/2502.13428.pdf>)
