# IDALC: A Semi-Supervised Framework for Intent Detection and Active Learning based Correction

Source: [IDALC: A Semi-Supervised Framework for Intent Detection and Active Learning based Correction](<https://www.sota2.com/research/paper/6912c3162828b7cc6937dd3b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-18T05:00:04.466Z

Authors: Ankan Mullick, Sukannya Purkayastha, Saransh Sharma, Pawan Goyal, Niloy Ganguly

Published: 2025-11-08T08:32:59.000Z

## Abstract

Voice-controlled dialog systems have become immensely popular due to their ability to perform a wide range of actions in response to diverse user queries. These agents possess a predefined set of skills or intents to fulfill specific user tasks. But every system has its own limitations. There are instances where, even for known intents, if any model exhibits low confidence, it results in rejection of utterances that necessitate manual annotation. Additionally, as time progresses, there may be a need to retrain these agents with new intents from the system-rejected queries to carry out additional tasks. Labeling all these emerging intents and rejected utterances over time is impractical, thus calling for an efficient mechanism to reduce annotation costs. In this paper, we introduce IDALC (Intent Detection and Active Learning based Correction), a semi-supervised framework designed to detect user intents and rectify system-rejected utterances while minimizing the need for human annotation. Empirical findings on various benchmark datasets demonstrate that our system surpasses baseline methods, achieving a 5-10% higher accuracy and a 4-8% improvement in macro-F1. Remarkably, we maintain the overall annotation cost at just 6-10% of the unlabelled data available to the system. The overall framework of IDALC is shown in Fig. 1

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Intent Detection on SNIPS Type 1 (test)](<https://www.sota2.com/research/sota/intent-detection-on-snips-type-1-test.md>): Intent Detection; SNIPS Type 1 (test); Accuracy: 98.6.

- [Intent Detection on SNIPS Type 2 (test)](<https://www.sota2.com/research/sota/intent-detection-on-snips-type-2-test.md>): Intent Detection; SNIPS Type 2 (test); Accuracy: 98.9.

- [Intent Detection on SNIPS Type 3 (test)](<https://www.sota2.com/research/sota/intent-detection-on-snips-type-3-test.md>): Intent Detection; SNIPS Type 3 (test); Accuracy: 96.2.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2511.05921>)

[PDF](<https://arxiv.org/pdf/2511.05921.pdf>)
