# Towards Semantic Noise Cleansing of Categorical Data based on Semantic Infusion

Source: [Towards Semantic Noise Cleansing of Categorical Data based on Semantic Infusion](<https://www.sota2.com/research/paper/68fa66fe1e209131cea138c6>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:03:19.943Z

Authors: Rishabh Gupta, Rajesh N Rao

Published: 2020-02-06T13:11:46.000Z

## Abstract

Semantic Noise affects text analytics activities for the domain-specific industries significantly. It impedes the text understanding which holds prime importance in the critical decision making tasks. In this work, we formalize semantic noise as a sequence of terms that do not contribute to the narrative of the text. We look beyond the notion of standard statistically-based stop words and consider the semantics of terms to exclude the semantic noise. We present a novel Semantic Infusion technique to associate meta-data with the categorical corpus text and demonstrate its near-lossless nature. Based on this technique, we propose an unsupervised text-preprocessing framework to filter the semantic noise using the context of the terms. Later we present the evaluation results of the proposed framework using a web forum dataset from the automobile-domain.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2002.02238>)

[PDF](<https://arxiv.org/pdf/2002.02238.pdf>)
