A Smart Binaural Hearing Aid Architecture Leveraging a Smartphone APP With Deep-Learning Speech Enhancement

被引:6
|
作者
Li, Yingdan [1 ]
Chen, Fei [1 ]
Sun, Zhuoyi [2 ]
Ji, Junyu [3 ]
Jia, Wen [4 ]
Wang, Zhihua [5 ,6 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin Key Lab Imaging & Sensing Microelect Tech, Tianjin 300072, Peoples R China
[2] Tsinghua Univ, Inst Microelect, Beijing 100084, Peoples R China
[3] Shenzhen Zhiting Technol Co Ltd, Shenzhen Eartech Co Ltd, Shenzhen 518100, Peoples R China
[4] Tsinghua Univ Shenzhen, Res Inst, Shenzhen 518057, Peoples R China
[5] Tsinghua Univ, Inst Microelect, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
[6] Tsinghua Univ, Res Inst, Shenzhen 518057, Peoples R China
关键词
Binaural hearing aids; smartphone; real-time se app; e-health; deep learning; RECOGNITION; DESIGN; NOISE;
D O I
10.1109/ACCESS.2020.2982212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a smartphone-based binaural hearing aid architecture for improving the speech intelligibility of hearing aid users. The proposed system consists of an earpiece, a smartphone and an application that performs real-time speech enhancement. The speaker & x2019;s voice, which is picked up by the microphone of the earpiece that is worn on the ear, is transmitted to the smartphone via wireless technology. After the speech intelligibility is improved in real time by the deep learning speech enhancement application, it is returned to the earpiece and generates sound. Deep learning speech enhancement algorithms can be used without performing burdensome calculations on the processors in the hearing aid. The results showed that the average usage of the central processing unit in the smartphone was approximately 26 & x0025;, and the signal-to-noise ratios improve by at least 20 & x0025;. The presented objective and subjective results show that the proposed method achieves comparatively more noise suppression without distorting the audio.
引用
收藏
页码:56798 / 56810
页数:13
相关论文
共 36 条
  • [11] Smartphone-Based Noise Adaptive Speech Enhancement for Hearing Aid Applications
    Panahi, Issa
    Kehtarnavaz, Nasser
    Thibodeau, Linda
    2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 85 - 88
  • [12] Restoring speech intelligibility for hearing aid users with deep learning
    Diehl, Peter Udo
    Singer, Yosef
    Zilly, Hannes
    Schoenfeld, Uwe
    Meyer-Rachner, Paul
    Berry, Mark
    Sprekeler, Henning
    Sprengel, Elias
    Pudszuhn, Annett
    Hofmann, Veit M.
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [13] Restoring speech intelligibility for hearing aid users with deep learning
    Peter Udo Diehl
    Yosef Singer
    Hannes Zilly
    Uwe Schönfeld
    Paul Meyer-Rachner
    Mark Berry
    Henning Sprekeler
    Elias Sprengel
    Annett Pudszuhn
    Veit M. Hofmann
    Scientific Reports, 13
  • [14] A MACHINE LEARNING APPROACH FOR COMPUTATIONALLY AND ENERGY EFFICIENT SPEECH ENHANCEMENT IN BINAURAL HEARING AIDS
    Ayllon, David
    Gil-Pita, Roberto
    Rosa-Zurera, Manuel
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 6515 - 6519
  • [15] Unsteady flow-field forecasting leveraging a hybrid deep-learning architecture
    Guo, Chunyu
    Wang, Yonghao
    Han, Yang
    Ji, Minglei
    Wu, Yanyuan
    PHYSICS OF FLUIDS, 2024, 36 (06)
  • [16] HEARING AID-CONTROLLED BEAMFORMER FOR BINAURAL SPEECH ENHANCEMENT USING A MODEL-BASED APPROACH
    Kavalekalam, Mathew Shaji
    Nielsen, Jesper K.
    Christensen, Mads G.
    Boldt, Jesper B.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 321 - 325
  • [17] A novel intelligent smart traffic system using a deep-learning architecture
    Ahmed A. Alsheikhy
    Yahia F. Said
    Tawfeeq Shawly
    Multimedia Tools and Applications, 2024, 83 : 37913 - 37926
  • [18] A DEEP LEARNING BASED BINAURAL SPEECH ENHANCEMENT APPROACH WITH SPATIAL CUES PRESERVATION
    Sun, Xingwei
    Xia, Risheng
    Li, Junfeng
    Yan, Yonghong
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 5766 - 5770
  • [19] A novel intelligent smart traffic system using a deep-learning architecture
    Alsheikhy, Ahmed A.
    Said, Yahia F.
    Shawly, Tawfeeq
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (13) : 37913 - 37926
  • [20] Speech Enhancement for Hearing Aids with Deep Learning on Environmental Noises
    Park, Gyuseok
    Cho, Woohyeong
    Kim, Kyu-Sung
    Lee, Sangmin
    APPLIED SCIENCES-BASEL, 2020, 10 (17):