# Bisecting K-Means in RAG for Enhancing Question-Answering Tasks Performance in Telecommunications

Source: [Bisecting K-Means in RAG for Enhancing Question-Answering Tasks Performance in Telecommunications](<https://www.sota2.com/research/paper/68fa772f1e209131cea71a82>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T04:12:54.213Z

Authors: Pedro Sousa, Cl\\'audio Klautau Mello, Frank B. Morte, Luis F. Solis Navarro

Published: 2025-02-27T15:23:18.000Z

## Abstract

Question-answering tasks in the telecom domain are still reasonably unexplored in the literature, primarily due to the field's rapid changes and evolving standards. This work presents a novel Retrieval-Augmented Generation framework explicitly designed for the telecommunication domain, focusing on datasets composed of 3GPP documents. The framework introduces the use of the Bisecting K-Means clustering technique to organize the embedding vectors by contents, facilitating more efficient information retrieval. By leveraging this clustering technique, the system pre-selects a subset of clusters that are most similar to the user's query, enhancing the relevance of the retrieved information. Aiming for models with lower computational cost for inference, the framework was tested using Small Language Models, demonstrating improved performance with an accuracy of 66.12% on phi-2 and 72.13% on phi-3 fine-tuned models, and reduced training time.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2502.20188>)

[PDF](<https://arxiv.org/pdf/2502.20188.pdf>)
