# Adaptive Chunking: Optimizing Chunking-Method Selection for RAG

Source: [Adaptive Chunking: Optimizing Chunking-Method Selection for RAG](<https://www.sota2.com/research/paper/69c60f2d0636e5bf4afc860d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-28T05:00:04.915Z

Authors: Paulo Roberto de Moura J\\'unior, Jean Lelong, Annabelle Blangero

Published: 2026-03-26T11:20:52.000Z

## Abstract

The effectiveness of Retrieval-Augmented Generation (RAG) is highly dependent on how documents are chunked, that is, segmented into smaller units for indexing and retrieval. Yet, commonly used "one-size-fits-all" approaches often fail to capture the nuanced structure and semantics of diverse texts. Despite its central role, chunking lacks a dedicated evaluation framework, making it difficult to assess and compare strategies independently of downstream performance. We challenge this paradigm by introducing Adaptive Chunking, a framework that selects the most suitable chunking strategy for each document based on a set of five novel intrinsic, document-based metrics: References Completeness (RC), Intrachunk Cohesion (ICC), Document Contextual Coherence (DCC), Block Integrity (BI), and Size Compliance (SC), which directly assess chunking quality across key dimensions. To support this framework, we also introduce two new chunkers, an LLM-regex splitter and a split-then-merge recursive splitter, alongside targeted post-processing techniques. On a diverse corpus spanning legal, technical, and social science domains, our metric-guided adaptive method significantly improves downstream RAG performance. Without changing models or prompts, our framework increases RAG outcomes, raising answers correctness to 72% (from 62-64%) and increasing the number of successfully answered questions by over 30% (65 vs. 49). These results demonstrate that adaptive, document-aware chunking, guided by a complementary suite of intrinsic metrics, offers a practical and effective path to more robust RAG systems. Code available at https://github.com/ekimetrics/adaptive-chunking.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Retrieval-Augmented Generation on RAG Evaluation Dataset 99 queries (test)](<https://www.sota2.com/research/sota/retrieval-augmented-generation-on-rag-evaluation-dataset-99-queries-test.md>): Retrieval-Augmented Generation; RAG Evaluation Dataset 99 queries (test); Retrieval Completeness: 67.68.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2603.25333>)

[PDF](<https://arxiv.org/pdf/2603.25333.pdf>)
