# Privacy-preserving Prosody Representation Learning

Source: [Privacy-preserving Prosody Representation Learning](<https://www.sota2.com/research/paper/6a1e63b9dbd7150506f852e1>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T05:00:51.557Z

Authors: Kevin Everson, Mari Ostendorf

Published: 2026-05-29T22:49:56.000Z

## Abstract

Speech representations that capture prosodic information can be useful for both understanding and generation. However, speaker characteristics are reflected in acoustic-prosodic features (e.g., pitch). To address privacy concerns from the leakage of identity information, we propose a new self-supervised approach to learning prosody representations that incorporates speaker disentanglement strategies. We evaluate our encoder on three tasks to probe representation capabilities, including pitch reconstruction and detection of different prosodic events. Our encoder outperforms raw prosody and HuBERT-base baselines, achieving strong speaker disentanglement without adverse impact on prosody-related downstream tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Phrase boundary detection on ToBI (test)](<https://www.sota2.com/research/sota/phrase-boundary-detection-on-tobi-test.md>): Phrase boundary detection; ToBI (test); F1 Score: 82.

- [Syllable prominence detection on ToBI (test)](<https://www.sota2.com/research/sota/syllable-prominence-detection-on-tobi-test.md>): Syllable prominence detection; ToBI (test); F1 Score: 86.

- [Pitch Reconstruction on LibriTTS (test)](<https://www.sota2.com/research/sota/pitch-reconstruction-on-libritts-test.md>): Pitch reconstruction; LibriTTS (test); Standard MSE: 0.024.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2606.00407>)

[PDF](<https://arxiv.org/pdf/2606.00407.pdf>)
