# Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking

Source: [Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking](<https://www.sota2.com/research/paper/68fa79f81e209131cea80581>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T05:09:30.174Z

Authors: Hai Toan Nguyen, Tien Dat Nguyen, Viet Ha Nguyen

Published: 2025-07-14T05:21:58.000Z

## Abstract

Retrieval-Augmented Generation (RAG) systems commonly use chunking strategies for retrieval, which enhance large language models (LLMs) by enabling them to access external knowledge, ensuring that the retrieved information is up-to-date and domain-specific. However, traditional methods often fail to create chunks that capture sufficient semantic meaning, as they do not account for the underlying textual structure. This paper proposes a novel framework that enhances RAG by integrating hierarchical text segmentation and clustering to generate more meaningful and semantically coherent chunks. During inference, the framework retrieves information by leveraging both segment-level and cluster-level vector representations, thereby increasing the likelihood of retrieving more precise and contextually relevant information. Evaluations on the NarrativeQA, QuALITY, and QASPER datasets indicate that the proposed method achieved improved results compared to traditional chunking techniques.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2507.09935>)

[PDF](<https://arxiv.org/pdf/2507.09935.pdf>)
