# A Multi-Stage Separation-and-Classification Framework Guided by Complementary Acoustic-to-Semantic Clues

Source: [A Multi-Stage Separation-and-Classification Framework Guided by Complementary Acoustic-to-Semantic Clues](<https://www.sota2.com/research/paper/6a3b64d7206542251d7c992d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-25T05:00:34.132Z

Authors: Younghoo Kwon, Junwoo Park, Han Yin, Jung-Woo Choi

Published: 2026-06-23T12:43:22.000Z

## Abstract

This report describes the system proposed for the DCASE 2026 Challenge Task 4: Spatial Semantic Segmentation of Sound Scenes (S5). Specifically, we develop a multi-stage framework in which each stage couples a separation model with a classification model. The first stage performs source separation and classification directly on the multi-channel mixture. Its outputs are then propagated to the following stage as two complementary clues that progressively refine each target estimate: (i) an enrollment clue, the separated waveform itself, serving as a low-level acoustic reference; and (ii) a class clue, the predicted label encoded as a one-hot vector. The third stage reuses the second-stage outputs under the same scheme, forming an iterative self-guided refinement process. In addition, we use a fine-grained frame-level audio embedding from an audio encoder pretrained on a large audio corpus as an additional clue to further improve the audio separation performance. On the test set, the proposed system achieves a CAPI-SDRi of 15.51 dB, a mixture accuracy of 71.09\\%, and a source accuracy of 78.62\\%; with an improvement of 7.02 dB, 10.38\\%p and 8.22\\%p compared with the challenge baseline, respectively.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2606.24512>)

[PDF](<https://arxiv.org/pdf/2606.24512.pdf>)
