Detecting Fake Audio of Arabic Speakers Using Self-Supervised Deep Learning

被引:1
|
作者
Almutairi, Zaynab M. [1 ]
Elgibreen, Hebah [1 ,2 ]
机构
[1] King Saud Univ, Coll Comp & Informat Sci, Informat Technol Dept, Riyadh 11451, Saudi Arabia
[2] King Saud Univ, Artificial Intelligence Ctr Adv Studies Thakaa, Riyadh 11451, Saudi Arabia
关键词
Audio deepfake; imitation fakeness; Arabic-AD method; modern standard Arabic (MSA); machine learning (ML); deep learning (DL);
D O I
10.1109/ACCESS.2023.3286864
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of the most significant discussions in forensics is Audio Deepfake, where AI-generated tools are used to clone audio content of people's voices. Although it was intended to improve people's lives, attackers utilized it maliciously, compromising the public's safety. Thus, Machine Learning (ML) and Deep Learning (DL) methods have been developed to detect imitated or synthetically faked voices. However, the developed methods suffered from massive training data or excessive pre-processing. To the author's best knowledge, Arabic speech has not yet been explored with synthetic fake audio, and it is very limited to the challenged fakeness, which is imitation. This paper proposed a new Audio Deepfake detection method called Arabic-AD based on self-supervised learning techniques to detect both synthetic and imitated voices. Additionally, it contributed to the literature by creating the first synthetic dataset of a single speaker who perfectly speaks Modern Standard Arabic (MSA). Besides, the accent was also considered by collecting Arabic recordings from non-Arabic speakers to evaluate the robustness of Arabic-AD. Three extensive experiments were conducted to measure the proposed method and compare it to well-known benchmarks in the literature. As a result, Arabic-AD outperformed other state-of-the-art methods with the lowest EER rate (0.027%), and high detection accuracy (97%) while avoiding the need for excessive training.
引用
收藏
页码:72134 / 72147
页数:14
相关论文
共 50 条
  • [1] Audio self-supervised learning: A survey
    Liu, Shuo
    Mallol-Ragolta, Adria
    Parada-Cabaleiro, Emilia
    Qian, Kun
    Jing, Xin
    Kathan, Alexander
    Hu, Bin
    Schuller, Bjorn W.
    [J]. PATTERNS, 2022, 3 (12):
  • [2] Detecting Anomalies in Retinal Diseases Using Generative, Discriminative, and Self-supervised Deep Learning
    Burlina, Philippe
    Paul, William
    Liu, T. Y. Alvin
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2022, 140 (02) : 185 - 189
  • [3] Weather Recognition Using Self-supervised Deep Learning
    Acuna-Escobar, Diego
    Intriago-Pazmino, Monserrate
    Ibarra-Fiallo, Julio
    [J]. SMART TECHNOLOGIES, SYSTEMS AND APPLICATIONS, SMARTTECH-IC 2021, 2022, 1532 : 161 - 174
  • [4] AUDIO ALBERT: A LITE BERT FOR SELF-SUPERVISED LEARNING OF AUDIO REPRESENTATION
    Chi, Po-Han
    Chung, Pei-Hung
    Wu, Tsung-Han
    Hsieh, Chun-Cheng
    Chen, Yen-Hao
    Li, Shang-Wen
    Lee, Hung-yi
    [J]. 2021 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP (SLT), 2021, : 344 - 350
  • [5] Detecting galaxy tidal features using self-supervised representation learning
    Desmons, Alice
    Brough, Sarah
    Lanusse, Francois
    [J]. MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2024, 531 (04) : 4070 - 4084
  • [6] Detecting Intentional AIS Shutdown in Open Sea Maritime Surveillance Using Self-Supervised Deep Learning
    Bernabe, Pierre
    Gotlieb, Arnaud
    Legeard, Bruno
    Marijan, Dusica
    Sem-Jacobsen, Frank Olaf
    Spieker, Helge
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 1166 - 1177
  • [7] Detecting Arabic Fake News Using Machine Learning
    Khalil, Ashwaq
    Jarrah, Moath
    Aldwairi, Monther
    Jararweh, Yaser
    [J]. 2021 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT DATA SCIENCE TECHNOLOGIES AND APPLICATIONS (IDSTA), 2021, : 171 - 177
  • [8] Road Condition Anomaly Detection using Self-Supervised Learning from Audio
    Gim, U-Ju
    [J]. 2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 675 - 680
  • [9] Deep active sampling with self-supervised learning
    Shi, Haochen
    Zhou, Hui
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2023, 17 (04)
  • [10] Self-Supervised Deep Metric Learning for Pointsets
    Arsomngern, Pattaramanee
    Long, Cheng
    Suwajanakorn, Supasorn
    Nutanong, Sarana
    [J]. 2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2171 - 2176