# VQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net architecture

Source: [VQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net architecture](<https://www.sota2.com/research/paper/68fa67ab1e209131cea17a49>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:19:06.029Z

Authors: Da-Yi Wu, Yen-Hao Chen, Hung-Yi Lee

Published: 2020-06-07T14:01:16.000Z

## Abstract

Voice conversion (VC) is a task that transforms the source speaker's timbre, accent, and tones in audio into another one's while preserving the linguistic content. It is still a challenging work, especially in a one-shot setting. Auto-encoder-based VC methods disentangle the speaker and the content in input speech without given the speaker's identity, so these methods can further generalize to unseen speakers. The disentangle capability is achieved by vector quantization (VQ), adversarial training, or instance normalization (IN). However, the imperfect disentanglement may harm the quality of output speech. In this work, to further improve audio quality, we use the U-Net architecture within an auto-encoder-based VC system. We find that to leverage the U-Net architecture, a strong information bottleneck is necessary. The VQ-based method, which quantizes the latent vectors, can serve the purpose. The objective and the subjective evaluations show that the proposed method performs well in both audio naturalness and speaker similarity.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Voice Conversion on VCTK seen-to-seen (test)](<https://www.sota2.com/research/sota/voice-conversion-on-vctk-seen-to-seen-test.md>): Voice Conversion; VCTK seen-to-seen (test); MOS: 1.76.

- [Voice Conversion on LibriTTS to VCTK (unseen-to-seen) (test-clean)](<https://www.sota2.com/research/sota/voice-conversion-on-libritts-to-vctk-unseen-to-seen-test-clean.md>): Voice Conversion; LibriTTS to VCTK (unseen-to-seen) (test-clean); MOS: 1.73.

- [Voice Conversion on LibriTTS unseen-to-unseen (test-clean)](<https://www.sota2.com/research/sota/voice-conversion-on-libritts-unseen-to-unseen-test-clean.md>): Voice Conversion; LibriTTS unseen-to-unseen (test-clean); MOS: 1.83.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2006.04154>)

[PDF](<https://arxiv.org/pdf/2006.04154.pdf>)
