Timezone: »

 
Poster
AutoVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss
Kaizhi Qian · Yang Zhang · Shiyu Chang · Xuesong Yang · Mark Hasegawa-Johnson

Thu Jun 13 06:30 PM -- 09:00 PM (PDT) @ Pacific Ballroom #225
in Posters Thu »

Despite the progress in voice conversion, many-to-many voice conversion trained on non-parallel data, as well as zero-shot voice conversion, remains under-explored. Deep style transfer algorithms, generative adversarial networks (GAN) in particular, are being applied as new solutions in this field. However, GAN training is very sophisticated and difficult, and there is no strong evidence that its generated speech is of good perceptual quality. In this paper, we propose a new style transfer scheme that involves only an autoencoder with a carefully designed bottleneck. We formally show that this scheme can achieve distribution-matching style transfer by training only on self-reconstruction loss. Based on this scheme, we proposed AutoVC, which achieves state-of-the-art results in many-to-many voice conversion with non-parallel data, and which is the first to perform zero-shot voice conversion.

Keywords: Deep Generative Models · Speech Processing

Author Information

Kaizhi Qian (UIUC)
Yang Zhang (IBM-MIT Research Lab)
Shiyu Chang (MIT-IBM Watson AI Lab)
Xuesong Yang (University of Illinois at Urbana-Champaign)
Mark Hasegawa-Johnson (University of Illinois)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors