# One-shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalization

Source: [One-shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalization](<https://www.sota2.com/research/paper/68fa66381e209131cea0ee9f>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:44:30.600Z

Authors: Ju-chieh Chou, Cheng-chieh Yeh, Hung-yi Lee

Published: 2019-04-10T16:22:18.000Z

## Abstract

Recently, voice conversion (VC) without parallel data has been successfully adapted to multi-target scenario in which a single model is trained to convert the input voice to many different speakers. However, such model suffers from the limitation that it can only convert the voice to the speakers in the training data, which narrows down the applicable scenario of VC. In this paper, we proposed a novel one-shot VC approach which is able to perform VC by only an example utterance from source and target speaker respectively, and the source and target speaker do not even need to be seen during training. This is achieved by disentangling speaker and content representations with instance normalization (IN). Objective and subjective evaluation shows that our model is able to generate the voice similar to target speaker. In addition to the performance measurement, we also demonstrate that this model is able to learn meaningful speaker representations without any supervision.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Voice Conversion on VCTK seen-to-seen (test)](<https://www.sota2.com/research/sota/voice-conversion-on-vctk-seen-to-seen-test.md>): Voice Conversion; VCTK seen-to-seen (test); MOS: 2.22.

- [Voice Conversion on LibriTTS to VCTK (unseen-to-seen) (test-clean)](<https://www.sota2.com/research/sota/voice-conversion-on-libritts-to-vctk-unseen-to-seen-test-clean.md>): Voice Conversion; LibriTTS to VCTK (unseen-to-seen) (test-clean); MOS: 1.92.

- [Voice Conversion on LibriTTS unseen-to-unseen (test-clean)](<https://www.sota2.com/research/sota/voice-conversion-on-libritts-unseen-to-unseen-test-clean.md>): Voice Conversion; LibriTTS unseen-to-unseen (test-clean); MOS: 2.12.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1904.05742>)

[PDF](<https://arxiv.org/pdf/1904.05742.pdf>)
