Timezone: »
We propose Guided-TTS, a high-quality text-to-speech (TTS) model that does not require any transcript of target speaker using classifier guidance. Guided-TTS combines an unconditional diffusion probabilistic model with a separately trained phoneme classifier for classifier guidance. Our unconditional diffusion model learns to generate speech without any context from untranscribed speech data. For TTS synthesis, we guide the generative process of the diffusion model with a phoneme classifier trained on a large-scale speech recognition dataset. We present a norm-based scaling method that reduces the pronunciation errors of classifier guidance in Guided-TTS. We show that Guided-TTS achieves a performance comparable to that of the state-of-the-art TTS model, Grad-TTS, without any transcript for LJSpeech. We further demonstrate that Guided-TTS performs well on diverse datasets including a long-form untranscribed dataset.
Author Information
Heeseung Kim (Seoul National University)
Sungwon Kim (Seoul National University)
Sungroh Yoon (Seoul National University)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Spotlight: Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance »
Wed. Jul 20th 03:25 -- 03:30 PM Room Hall G
More from the Same Authors
-
2023 : De-stereotyping Text-to-image Models through Prompt Tuning »
Eunji Kim · Siwon Kim · Chaehun Shin · Sungroh Yoon -
2023 Poster: Improving Visual Prompt Tuning for Self-supervised Vision Transformers »
Seungryong Yoo · Eunji Kim · Dahuin Jung · JUNGBEOM LEE · Sungroh Yoon -
2023 Poster: On the Impact of Knowledge Distillation for Model Interpretability »
Hyeongrok Han · Siwon Kim · Hyun-Soo Choi · Sungroh Yoon -
2023 Poster: Probabilistic Concept Bottleneck Models »
Eunji Kim · Dahuin Jung · Sangha Park · Siwon Kim · Sungroh Yoon -
2022 Poster: AutoSNN: Towards Energy-Efficient Spiking Neural Networks »
Byunggook Na · Jisoo Mok · Seongsik Park · Dongjin Lee · Hyeokjun Choe · Sungroh Yoon -
2022 Poster: Dataset Condensation with Contrastive Signals »
Saehyung Lee · SANGHYUK CHUN · Sangwon Jung · Sangdoo Yun · Sungroh Yoon -
2022 Spotlight: Dataset Condensation with Contrastive Signals »
Saehyung Lee · SANGHYUK CHUN · Sangwon Jung · Sangdoo Yun · Sungroh Yoon -
2022 Spotlight: AutoSNN: Towards Energy-Efficient Spiking Neural Networks »
Byunggook Na · Jisoo Mok · Seongsik Park · Dongjin Lee · Hyeokjun Choe · Sungroh Yoon -
2022 Poster: Confidence Score for Source-Free Unsupervised Domain Adaptation »
Jonghyun Lee · Dahuin Jung · Junho Yim · Sungroh Yoon -
2022 Spotlight: Confidence Score for Source-Free Unsupervised Domain Adaptation »
Jonghyun Lee · Dahuin Jung · Junho Yim · Sungroh Yoon -
2019 Poster: FloWaveNet : A Generative Flow for Raw Audio »
Sungwon Kim · Sang-gil Lee · Jongyoon Song · Jaehyeon Kim · Sungroh Yoon -
2019 Oral: FloWaveNet : A Generative Flow for Raw Audio »
Sungwon Kim · Sang-gil Lee · Jongyoon Song · Jaehyeon Kim · Sungroh Yoon -
2019 Poster: HexaGAN: Generative Adversarial Nets for Real World Classification »
Uiwon Hwang · Dahuin Jung · Sungroh Yoon -
2019 Oral: HexaGAN: Generative Adversarial Nets for Real World Classification »
Uiwon Hwang · Dahuin Jung · Sungroh Yoon