Audio signal based danger detection using signal processing and deep learning

被引:2
|
作者
Fime, Awal Ahmed [1 ]
Ashikuzzaman, Md. [1 ]
Aziz, Abdul [1 ]
机构
[1] Khulna Univ Engn & Technol, Dept Comp Sci & Engn, Khulna 9203, Bangladesh
关键词
Artificial intelligence; Audio classification; Deep learning; IoT; Signal processing; Women and child security;
D O I
10.1016/j.eswa.2023.121646
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Since there have been more and more incidents of women being harassed in the recent past, girls need to think twice before going out of their houses. Sometimes, they are not even safe in their house or workplace. These circumstance does not change for children of all genders who stay alone because of their working parents or for other reasons. Also, there is no such organized procedure to ensure safety and take women and children out of such violence and harassment. To address this problem, the authors of this paper developed an Android -based automated system to detect danger for women and children using audio from the surroundings. As the Android phone is available to everyone nowadays, they focused on using this device rather than developing a system on some external hardware. Different signal processing methods with deep learning techniques are used for this work. This work also addresses noise from the environment for any chaos and nullifies them using different noise reduction techniques such as Reduce Energy Noise, Reduce Mel Frequency Cepstrum Coefficient (MFCC) up Noise, Reduce Median Noise, Reduce Centroid Noise, Audio DeNoise, Noisereduce by Sainburf et al. & Butterworth high pass filter. The Noisereduce by Sainburg et al. along with the InceptionV3 model architecture turns out to be the best to classify audio with 95.51% accuracy. A new model called AudioViT is introduced. It uses a Visual Transformer and Residual Network to identify the audio signal. The Android application also takes necessary action when any unfavorable situation is detected. Android device users can use this application without any cost, which will pave the way to ensure the safety of women and children.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Deep Learning for Audio Signal Processing
    Purwins, Hendrik
    Li, Bo
    Virtanen, Tuomas
    Schlueter, Jan
    Chang, Shuo-Yiin
    Sainath, Tara
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2019, 13 (02) : 206 - 219
  • [2] Intelligent Audio Signal Processing for Detecting Rainforest Species Using Deep Learning
    Kumar, Rakesh
    Gupta, Meenu
    Ahmed, Shakeel
    Alhumam, Abdulaziz
    Aggarwal, Tushar
    [J]. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2022, 31 (02): : 693 - 706
  • [3] Mood detection analyzing lyrics and audio signal based on deep learning architectures
    Pyrovolakis, Konstantinos
    Tzouveli, Paraskevi
    Stamou, George
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9363 - 9370
  • [4] Anomaly Detection Method in Railway Using Signal Processing and Deep Learning
    Shim, Jaeseok
    Koo, Jeongseo
    Park, Yongwoon
    Kim, Jaehoon
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [5] Fault detection in insulators based on ultrasonic signal processing using a hybrid deep learning technique
    Frizzo Stefenon, Stefano
    Zanetti Freire, Roberto
    Henrique Meyer, Luiz
    Picolotto Corso, Marcelo
    Sartori, Andreza
    Nied, Ademir
    Rodrigues Klaar, Anne Carolina
    Yow, Kin-Choong
    [J]. IET SCIENCE MEASUREMENT & TECHNOLOGY, 2020, 14 (10) : 953 - 961
  • [6] A Broiler Stress Detection System Based on Audio Signal Processing
    Jakovljevic, Niksa
    Maljkovic, Nina
    Miskovic, Dragisa
    Knezevic, Petar
    Delic, Vlado
    [J]. 2019 27TH TELECOMMUNICATIONS FORUM (TELFOR 2019), 2019, : 313 - 316
  • [7] Audio Signal Processing Based on FPGA
    Zhang, Jingbo
    Wang, Xiaofeng
    Zhang, Shufang
    [J]. MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS, 2014, 1049 : 1759 - 1764
  • [8] Entropy Algorithms Using Deep Learning for Signal Processing
    Jeon, Gwanggil
    [J]. ENTROPY, 2023, 25 (01)
  • [9] Deep Learning for Audio Signal Source Positioning Using Microphone Array
    Adanur, Resul
    Yesilyurt, Yildiray
    Sisman, Cem
    Sagir, Selim
    Kaya, Ismail
    [J]. 2019 SEVENTH INTERNATIONAL CONFERENCE ON DIGITAL INFORMATION PROCESSING AND COMMUNICATIONS (ICDIPC 2019), 2019, : 18 - 22
  • [10] A Novel Method for Malware Detection Using Audio Signal Processing Techniques
    Farrokhmanesh, Mehrdad
    Hamzeh, Ali
    [J]. 2016 ARTIFICIAL INTELLIGENCE AND ROBOTICS (IRANOPEN), 2016, : 85 - 91