Mel spectrogram-based audio forgery detection using CNN

被引:10
|
作者
Ustubioglu, Arda [2 ]
Ustubioglu, Beste [1 ]
Ulutas, Guzin [1 ]
机构
[1] Karadeniz Tech Univ, Dept Comp Engn, TR-61080 Trabzon, Turkey
[2] Trabzon Univ, Dept Management Informat Syst, Trabzon, Turkey
关键词
Copy-move forgery detection; Audio forgery; Audio forensic; Spectrogram-CNN; COPY-MOVE DETECTION; PITCH;
D O I
10.1007/s11760-022-02436-4
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this time of technology, digital speech can be created and falsified by a very diverse of hardware and software technologies. Audio copy-move forgery is an audio forgery technique that goals to create forged audio by hiding undesirable words or repeating wanted words in identical speech. Therefore, audio authentication has been a necessary requisition. In this study, an effective approach to spectral images based on audio copy-move forgery detection using convolutional neural networks (CNN) with data augmentation is proposed. There are only a few handcrafted methods conducted for the detection of audio copy-move forgery. None of the existing works on audio copy-move forgery detection has proposed deep feature learning from speech recording with Mel spectrogram. This is the first method to employ deep learning with Mel spectrogram of audio for the detection of audio copy-move forgery. The proposed CNN architecture classifies the suspicious Mel spectrogram images into two classes: original and forged. The proposed CNN system is successfully trained on these Mel spectrogram image feature extraction. The proposed algorithm has been tested on our datasets generated from Arabic Speech Corpus and TIMIT speech database. The results show the effectiveness, robustness of post-processing operations, and high accuracy of the proposed approach compared to other studies.
引用
收藏
页码:2211 / 2219
页数:9
相关论文
共 50 条
  • [1] Mel spectrogram-based audio forgery detection using CNN
    Arda Ustubioglu
    Beste Ustubioglu
    Guzin Ulutas
    [J]. Signal, Image and Video Processing, 2023, 17 : 2211 - 2219
  • [2] Detection of audio copy-move-forgery with novel feature matching on Mel spectrogram
    Ustubioglu, Beste
    Tahaoglu, Gul
    Ulutas, Guzin
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [3] A spectrogram-based audio fingerprinting system for content-based copy detection
    Ouali, Chahid
    Dumouchel, Pierre
    Gupta, Vishwa
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (15) : 9145 - 9165
  • [4] EFFICIENT SPECTROGRAM-BASED BINARY IMAGE FEATURE FOR AUDIO COPY DETECTION
    Ouali, Chahid
    Dumouchel, Pierre
    Gupta, Vishwa
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 1792 - 1796
  • [5] Spectrogram-Based Audio Classification of Nutrition Intake
    Kalantarian, Haik
    Alshurafa, Nabil
    Pourhomayoun, Mohammad
    Sarin, Shruti
    Le, Tuan
    Sarrafzadeh, Majid
    [J]. 2014 IEEE HEALTHCARE INNOVATION CONFERENCE (HIC), 2014, : 161 - 164
  • [6] A spectrogram-based audio fingerprinting system for content-based copy detection
    Chahid Ouali
    Pierre Dumouchel
    Vishwa Gupta
    [J]. Multimedia Tools and Applications, 2016, 75 : 9145 - 9165
  • [7] SPECTROGRAM-BASED CLASSIFICATION OF SPOKEN FOUL LANGUAGE USING DEEP CNN
    Wazir, Abdulaziz Saleh Ba
    Karim, Hezerul Abdul
    Abdullah, Mohd Haris Lye
    Mansor, Sarina
    AlDahoul, Nouar
    Fauzi, Mohammad Faizal Ahmad
    See, John
    [J]. 2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,
  • [8] Spectrogram-based Simultaneous Heartbeat and Blink Detection Using Doppler Sensor
    Yamamoto, Kohei
    Toyoda, Kentaroh
    Ohtsuki, Tomoaki
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [9] Audio Signal Mapping into Spectrogram-Based Images for Deep Learning Applications
    Ciric, Dejan
    Peric, Zoran
    Nikolic, Jelena
    Vucic, Nikola
    [J]. 2021 20TH INTERNATIONAL SYMPOSIUM INFOTEH-JAHORINA (INFOTEH), 2020,
  • [10] A Spectrogram-Based Method of Rg Detection for Explosion Monitoring
    O'Rourke, Colin T.
    Baker, G. Eli
    [J]. BULLETIN OF THE SEISMOLOGICAL SOCIETY OF AMERICA, 2017, 107 (01) : 34 - 42