HIGH-QUALITY NONPARALLEL VOICE CONVERSION BASED ON CYCLE-CONSISTENT ADVERSARIAL NETWORK

被引:0
|
作者
Fang, Fuming [1 ]
Yamagishi, Junichi [1 ,2 ]
Echizen, Isao [1 ]
Lorenzo-Trueba, Jaime [1 ]
机构
[1] Natl Inst Informat, Tokyo, Japan
[2] Univ Edinburgh, Edinburgh, Midlothian, Scotland
关键词
Voice conversion; deep learning; cycle-consistent adversarial network; generative adversarial network;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Although voice conversion (VC) algorithms have achieved remarkable success along with the development of machine learning, superior performance is still difficult to achieve when using nonparallel data. In this paper, we propose using a cycle-consistent adversarial network (Cyc1eGAN) for nonparallel data-based VC training. A Cyc1eGAN is a generative adversarial network (GAN) originally developed for unpaired image-to-image translation. A subjective evaluation of inter-gender conversion demonstrated that the proposed method significantly outperformed a method based on the Merlin open source neural network speech synthesis system (a parallel VC system adapted for our setup) and a GAN-based parallel VC system. This is the first research to show that the performance of a nonparallel VC method can exceed that of state-of-the-art parallel VC methods.
引用
收藏
页码:5279 / 5283
页数:5
相关论文
共 50 条
  • [21] Overwater Image Dehazing via Cycle-Consistent Generative Adversarial Network
    Zheng, Shunyuan
    Sun, Jiamin
    Liu, Qinglin
    Qi, Yuankai
    Yan, Jianen
    [J]. ELECTRONICS, 2020, 9 (11) : 1 - 19
  • [22] Cycle-consistent adversarial denoising network for multiphase coronary CT angiography
    Kang, Eunhee
    Koo, Hyun Jung
    Yang, Dong Hyun
    Seo, Joon Bum
    Ye, Jong Chul
    [J]. MEDICAL PHYSICS, 2019, 46 (02) : 550 - 562
  • [23] Unsupervised Image Dedusting via a Cycle-Consistent Generative Adversarial Network
    Gao, Guxue
    Lai, Huicheng
    Jia, Zhenhong
    [J]. REMOTE SENSING, 2023, 15 (05)
  • [24] A Deep Multimodal Adversarial Cycle-Consistent Network for Smart Enterprise System
    Li, Peng
    Laghari, Asif Ali
    Rashid, Mamoon
    Gao, Jing
    Gadekallu, Thippa Reddy
    Javed, Abdul Rehman
    Yin, Shoulin
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (01) : 693 - 702
  • [25] Attenuation Correction of PET/MR Using Cycle-Consistent Adversarial Network
    Gong, Kuang
    Yang, Jaewon
    Kim, Kyungsang
    El Fakhri, Georges
    Seo, Youngho
    Li, Quanzheng
    [J]. JOURNAL OF NUCLEAR MEDICINE, 2019, 60
  • [26] Cycle-consistent Conditional Adversarial Transfer Networks
    Li, Jingjing
    Chen, Erpeng
    Ding, Zhengming
    Zhu, Lei
    Lu, Ke
    Huang, Zi
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 747 - 755
  • [27] CyCADA Cycle-Consistent Adversarial Domain Adaptation
    Hoffman, Judy
    Tzeng, Eric
    Park, Taesung
    Zhu, Jun-Yan
    Isola, Phillip
    Saenko, Kate
    Efros, Alexei A.
    Darrell, Trevor
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [28] Speckle noise reduction for medical ultrasound images based on cycle-consistent generative adversarial network
    Liu, Jieyi
    Li, Changchun
    Liu, Liping
    Chen, Haobo
    Han, Hong
    Zhang, Bo
    Zhang, Qi
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [29] TaijiGNN: A New Cycle-Consistent Generative Neural Network for High-Quality Bidirectional Transformation between RGB and Multispectral Domains
    Liu, Xu
    Gherbi, Abdelouahed
    Li, Wubin
    Wei, Zhenzhou
    Cheriet, Mohamed
    [J]. SENSORS, 2021, 21 (16)
  • [30] Cycle-Consistent Adversarial GAN: The Integration of Adversarial Attack and Defense
    Jiang, Lingyun
    Qiao, Kai
    Qin, Ruoxi
    Wang, Linyuan
    Yu, Wanting
    Chen, Jian
    Bu, Haibing
    Yan, Bin
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2020, 2020