HIGH-QUALITY NONPARALLEL VOICE CONVERSION BASED ON CYCLE-CONSISTENT ADVERSARIAL NETWORK

被引:0
|
作者
Fang, Fuming [1 ]
Yamagishi, Junichi [1 ,2 ]
Echizen, Isao [1 ]
Lorenzo-Trueba, Jaime [1 ]
机构
[1] Natl Inst Informat, Tokyo, Japan
[2] Univ Edinburgh, Edinburgh, Midlothian, Scotland
关键词
Voice conversion; deep learning; cycle-consistent adversarial network; generative adversarial network;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Although voice conversion (VC) algorithms have achieved remarkable success along with the development of machine learning, superior performance is still difficult to achieve when using nonparallel data. In this paper, we propose using a cycle-consistent adversarial network (Cyc1eGAN) for nonparallel data-based VC training. A Cyc1eGAN is a generative adversarial network (GAN) originally developed for unpaired image-to-image translation. A subjective evaluation of inter-gender conversion demonstrated that the proposed method significantly outperformed a method based on the Merlin open source neural network speech synthesis system (a parallel VC system adapted for our setup) and a GAN-based parallel VC system. This is the first research to show that the performance of a nonparallel VC method can exceed that of state-of-the-art parallel VC methods.
引用
收藏
页码:5279 / 5283
页数:5
相关论文
共 50 条
  • [41] Neural Topic Modeling with Cycle-Consistent Adversarial Training
    Hu, Xuemeng
    Wang, Rui
    Zhou, Deyu
    Xiong, Yuxuan
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 9018 - 9030
  • [42] Interactive Elearning Application for Cycle-Consistent Adversarial Networks
    Dragomir, Marilena-Catalina
    Pupezescu, Valentin
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON VIRTUAL LEARNING (ICVL-2020), 2020, : 439 - 444
  • [43] End-to-end attack on text-based CAPTCHAs based on cycle-consistent generative adversarial network
    Li, Chunhui
    Chen, Xingshu
    Wang, Haizhou
    Wang, Peiming
    Zhang, Yu
    Wang, Wenxian
    [J]. NEUROCOMPUTING, 2021, 433 : 223 - 236
  • [44] Generating Cuneiform Signs with Cycle-Consistent Adversarial Networks
    Rusakov, Eugen
    Brandenbusch, Kai
    Fisseler, Denis
    Somel, Turna
    Fink, Gernot A.
    Weichert, Frank
    Muller, Gerfrid G. W.
    [J]. PROCEEDINGS OF THE 2019 WORKSHOP ON HISTORICAL DOCUMENT IMAGING AND PROCESSING (HIP' 19), 2019, : 19 - 24
  • [45] Chest CBCT-based Synthetic CT using Cycle-consistent Adversarial Network with Histogram Matching
    Qiu, Richard L. J.
    Lei, Yang
    Kesarwala, Aparna H.
    Higgins, Kristin
    Bradley, Jeffrey D.
    Curran, Walter J.
    Liu, Tian
    Yang, Xiaofeng
    [J]. MEDICAL IMAGING 2021: IMAGE PROCESSING, 2021, 11596
  • [46] Fast least-squares reverse time migration based on cycle-consistent generative adversarial network
    Huang, Yunbo
    Huang, Jianping
    Li, Zhenchun
    Liu, Bowen
    [J]. Zhongguo Shiyou Daxue Xuebao (Ziran Kexue Ban)/Journal of China University of Petroleum (Edition of Natural Science), 2023, 47 (03): : 55 - 61
  • [47] Adversarial Self-Defense for Cycle-Consistent GANs
    Bashkirova, Dina
    Usman, Ben
    Saenko, Kate
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [48] Road detection using cycle-consistent adversarial networks
    Wang, Yucheng
    Zhang, Juan
    Jiang, Hao
    Fang, Zhijun
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (05)
  • [49] Bone-Conducted Speech to Air-Conducted Speech Conversion Based on Cycle-Consistent Adversarial Networks
    Pan, Qing
    Zhou, Jian
    Gao, Teng
    Tao, Liang
    [J]. 2020 IEEE 3RD INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SIGNAL PROCESSING (ICICSP 2020), 2020, : 168 - 172
  • [50] Four Discriminator Cycle-Consistent Adversarial Network for Improving Railway Defective Fastener Inspection
    Liu, Jianwei
    Ma, Ziji
    Qiu, Yuan
    Ni, Xuefeng
    Shi, Bo
    Liu, Hongli
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) : 10636 - 10645