Detecting Audio Deepfakes: Integrating CNN and BiLSTM with Multi-Feature Concatenation

被引:0
|
作者
Wani, Taiba Majid [1 ]
Qadri, Syed Asif Ahmad [2 ]
Comminiello, Danilo [1 ]
Amerini, Irene [1 ]
机构
[1] Sapienza Univ Rome, Rome, Italy
[2] Natl Tsing Hua Univ, Hsinchu, Taiwan
关键词
Audio Deepfakes; Feature Concatenation; MFCC; CQCC; CQT; Mel spectrograms; CNN; BiLSTM;
D O I
10.1145/3658664.3659647
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Audio deepfake detection is emerging as a crucial field in digital media, as distinguishing real audio from deepfakes becomes increasingly challenging due to the advancement of deepfake technologies. These methods threaten information authenticity and pose serious security risks. Addressing this challenge, we propose a novel architecture that combines Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) for effective deepfake audio detection. Our approach is distinguished by the feature concatenation of a comprehensive set of acoustic features: Mel Frequency Cepstral Coefficients (MFCC), Mel spectrograms, Constant Q Cepstral Coefficients (CQCC), and Constant-Q Transform (CQT) vectors. In the proposed architecture, features processed by a CNN are concatenated into two multi-dimensional features for comprehensive analysis, then analyzed by a BiLSTM network to capture temporal dynamics and contextual dependencies in audio data. This synergistic method ensures an understanding of both spatial and sequential audio characteristics. We validate our model on the ASVSpoof 2019 and FoR datasets, using accuracy and Equal Error Rate (EER) metrics for the evaluation.
引用
收藏
页码:271 / 276
页数:6
相关论文
共 50 条
  • [41] Short-term Power Load Forecasting Based on TCN-BiLSTM-Attention and Multi-feature Fusion
    Feng, Yang
    Zhu, Jiashan
    Qiu, Pengjin
    Zhang, Xiaoqi
    Shuai, Chunyan
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024, : 5475 - 5486
  • [42] Data Reconstruction Methods in Multi-Feature Fusion CNN Model for Enhanced Human Activity Recognition
    Ko, Jae Eun
    Kim, Seunghui
    Sul, Jae Ho
    Kim, Sung Min
    SENSORS, 2025, 25 (04)
  • [43] A Hybrid Multi-Feature Semantic Similarity Based Online Social Recommendation System Using CNN
    Saraswathi, K.
    Mohanraj, V
    Suresh, Y.
    Senthilkumar, J.
    INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2021, 29 (SUPPL 2) : 333 - 352
  • [44] Transformer-CNN-based Multi-feature Aggregation Algorithm for Real Battlefield Image Dehazing
    Wang Y.
    Tong M.
    Yan X.
    Wei M.
    Binggong Xuebao/Acta Armamentarii, 2024, 45 (04): : 1070 - 1081
  • [45] A multi-feature fusion based method for detecting the moisture content of withered black tea
    Zhu, Fengle
    Wei, Haohao
    Shen, Yuecheng
    Zhang, Yuqian
    Xu, Ning
    Zheng, Hao
    Qiao, Xin
    Liu, Dengtao
    JOURNAL OF FOOD COMPOSITION AND ANALYSIS, 2025, 141
  • [46] Detecting bursts in the EEG of very and extremely premature infants using a multi-feature approach
    O'Toole, John M.
    Boylan, Geraldine B.
    Lloyd, Rhodri O.
    Goulding, Robert M.
    Vanhatalo, Sampsa
    Stevenson, Nathan J.
    MEDICAL ENGINEERING & PHYSICS, 2017, 45 : 42 - 50
  • [47] Gated CNN: Integrating multi-scale feature layers for object detection
    Yuan, Jin
    Xiong, Heng-Chang
    Xiao, Yi
    Guan, Weili
    Wang, Meng
    Hong, Richang
    Li, Zhi-Yong
    PATTERN RECOGNITION, 2020, 105
  • [48] Chinese power dispatching text entity recognition based on a double-layer BiLSTM and multi-feature fusion
    Wang, Min
    Zhou, Tao
    Wang, Haohao
    Zhai, Youchun
    Dong, Xiaobin
    ENERGY REPORTS, 2022, 8 : 980 - 987
  • [49] Snoring Sound Classification Using 1D-CNN Model Based on Multi-Feature Extraction
    Adesuyi, TosinAkinwale
    Kim, Byeong-Man
    Kim, Jongwan
    INTERNATIONAL JOURNAL OF FUZZY LOGIC AND INTELLIGENT SYSTEMS, 2022, 22 (01) : 1 - 10
  • [50] Lithium-ion battery SOH estimation method based on multi-feature and CNN-KAN
    Zhang, Zhao
    Liu, Xin
    Zhang, Runrun
    Liu, Xu Ming
    Chen, Shi
    Sun, Zhexuan
    Jiang, Heng
    Frontiers in Energy Research, 2024, 12