Speaker anonymization using generative adversarial networks

被引:0
|
作者
Jafari, Aya [1 ]
Al-Mousa, Amjed [1 ]
Jafar, Iyad [2 ]
机构
[1] Princess Sumaya Univ Technol, Comp Engn Dept, Amman, Jordan
[2] Univ Jordan, Comp Engn Dept, Amman, Jordan
关键词
Speaker anonymization; voice privacy; generative adversarial networks; CTGAN; x-vector;
D O I
10.3233/JIFS-223642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advent use of smart devices has enabled the emergence of many applications that facilitate user interaction through speech. However, speech reveals private and sensitive information about the user's identity, posing several security risks. For example, a speaker's speech can be acquired and used in speech synthesis systems to generate fake speech recordings that can be used to attack that speaker's verification system. One solution is to anonymize the speaker's identity from speech before using it. Existing anonymization schemes rely on using a pool of real speakers' identities for anonymization, which may result in associating a speaker's speech with an existing speaker. Hence, this paper investigates the use of Generative Adversarial Networks (GAN) to generate a pool of fake identities that are used for anonymization. Several GAN types were considered for this purpose, and the Conditional Tabular GAN (CTGAN) showed the best performance among all GAN types according to different metrics that measure the naturalness of the anonymized speech and its linguistic content.
引用
收藏
页码:3345 / 3359
页数:15
相关论文
共 50 条
  • [1] CIAGAN: Conditional Identity Anonymization Generative Adversarial Networks
    Maximov, Maxim
    Elezi, Ismail
    Leal-Taixe, Laura
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5446 - 5455
  • [2] Medical Image Synthesis for Data Augmentation and Anonymization Using Generative Adversarial Networks
    Shin, Hoo-Chang
    Tenenholtz, Neil A.
    Rogers, Jameson K.
    Schwarz, Christopher G.
    Senjem, Matthew L.
    Gunter, Jeffrey L.
    Andriole, Katherine P.
    Michalski, Mark
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, 2018, 11037 : 1 - 11
  • [3] Anonymization Through Data Synthesis Using Generative Adversarial Networks (ADS-GAN)
    Yoon, Jinsung
    Drumright, Lydia N.
    van der Schaar, Mihaela
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (08) : 2378 - 2388
  • [4] Semantic-aware deidentification generative adversarial networks for identity anonymization
    Kim, Hyeongbok
    Pang, Zhiqi
    Zhao, Lingling
    Su, Xiaohong
    Lee, Jin Suk
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (10) : 15535 - 15551
  • [5] Semantic-aware deidentification generative adversarial networks for identity anonymization
    Hyeongbok Kim
    Zhiqi Pang
    Lingling Zhao
    Xiaohong Su
    Jin Suk Lee
    Multimedia Tools and Applications, 2023, 82 : 15535 - 15551
  • [6] ANONYMIZING SPEECH WITH GENERATIVE ADVERSARIAL NETWORKS TO PRESERVE SPEAKER PRIVACY
    Meyer, Sarina
    Tilli, Pascal
    Denisov, Pavel
    Lux, Florian
    Koch, Julia
    Vu, Ngoc Thang
    2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, : 912 - 919
  • [7] DeepPrivacy: A Generative Adversarial Network for Face Anonymization
    Hukkelas, Hakon
    Mester, Rudolf
    Lindseth, Frank
    ADVANCES IN VISUAL COMPUTING, ISVC 2019, PT I, 2020, 11844 : 565 - 578
  • [8] MTGAN: Speaker Verification through Multitasking Triplet Generative Adversarial Networks
    Ding, Wenhao
    He, Liang
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 3633 - 3637
  • [9] GENERATIVE ADVERSARIAL SPEAKER EMBEDDING NETWORKS FOR DOMAIN ROBUST END-TO-END SPEAKER VERIFICATION
    Bhattacharya, Gautam
    Monteiro, Joao
    Alam, Jahangir
    Kenny, Patrick
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 6226 - 6230
  • [10] GDAGAN: An Anonymization Method for Graph Data Publishing Using Generative Adversarial Network
    Fang, Junbin
    Li, Aiping
    Jiang, Qianyue
    2019 6TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE 2019), 2019, : 309 - 313