# End-to-End Multi-Task Learning for Adjustable Joint Noise Reduction and Hearing Loss Compensation

Source: [End-to-End Multi-Task Learning for Adjustable Joint Noise Reduction and Hearing Loss Compensation](<https://www.sota2.com/research/paper/69c21a8c0636e5bf4afc485f>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-25T05:00:04.214Z

Authors: Philippe Gonzalez, Vera Margrethe Frederiksen, Torsten Dau, Tobias May

Published: 2026-03-20T18:05:23.000Z

## Abstract

A multi-task learning framework is proposed for optimizing a single deep neural network (DNN) for joint noise reduction (NR) and hearing loss compensation (HLC). A distinct training objective is defined for each task, and the DNN predicts two time-frequency masks. During inference, the amounts of NR and HLC can be adjusted independently by exponentiating each mask before combining them. In contrast to recent approaches that rely on training an auditory-model emulator to define a differentiable training objective, we propose an auditory model that is inherently differentiable, thus allowing end-to-end optimization. The audiogram is provided as an input to the DNN, thereby enabling listener-specific personalization without the need for retraining. Results show that the proposed approach not only allows adjusting the amounts of NR and HLC individually, but also improves objective metrics compared to optimizing a single training objective. It also outperforms a cascade of two DNNs that were separately trained for NR and HLC, and shows competitive HLC performance compared to a traditional hearing-aid prescription. To the best of our knowledge, this is the first study that uses an auditory model to train a single DNN for both NR and HLC across a wide range of listener profiles.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Joint Noise Reduction and Hearing Loss Compensation on Noisy speech processed with normal-hearing (NH) and hearing-impaired audiograms (test)](<https://www.sota2.com/research/sota/joint-noise-reduction-and-hearing-loss-compensation-on-noisy-speech-processed-with-normal-hearing-nh-and-hearing-impaired-audiograms-test.md>): Joint Noise Reduction and Hearing Loss Compensation; Noisy speech processed with normal-hearing (NH) and hearing-impaired audiograms (test); PESQ: 2.28.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2603.20387>)

[PDF](<https://arxiv.org/pdf/2603.20387.pdf>)