A Smart Binaural Hearing Aid Architecture Leveraging a Smartphone APP With Deep-Learning Speech Enhancement

被引:6
|
作者
Li, Yingdan [1 ]
Chen, Fei [1 ]
Sun, Zhuoyi [2 ]
Ji, Junyu [3 ]
Jia, Wen [4 ]
Wang, Zhihua [5 ,6 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin Key Lab Imaging & Sensing Microelect Tech, Tianjin 300072, Peoples R China
[2] Tsinghua Univ, Inst Microelect, Beijing 100084, Peoples R China
[3] Shenzhen Zhiting Technol Co Ltd, Shenzhen Eartech Co Ltd, Shenzhen 518100, Peoples R China
[4] Tsinghua Univ Shenzhen, Res Inst, Shenzhen 518057, Peoples R China
[5] Tsinghua Univ, Inst Microelect, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
[6] Tsinghua Univ, Res Inst, Shenzhen 518057, Peoples R China
关键词
Binaural hearing aids; smartphone; real-time se app; e-health; deep learning; RECOGNITION; DESIGN; NOISE;
D O I
10.1109/ACCESS.2020.2982212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a smartphone-based binaural hearing aid architecture for improving the speech intelligibility of hearing aid users. The proposed system consists of an earpiece, a smartphone and an application that performs real-time speech enhancement. The speaker & x2019;s voice, which is picked up by the microphone of the earpiece that is worn on the ear, is transmitted to the smartphone via wireless technology. After the speech intelligibility is improved in real time by the deep learning speech enhancement application, it is returned to the earpiece and generates sound. Deep learning speech enhancement algorithms can be used without performing burdensome calculations on the processors in the hearing aid. The results showed that the average usage of the central processing unit in the smartphone was approximately 26 & x0025;, and the signal-to-noise ratios improve by at least 20 & x0025;. The presented objective and subjective results show that the proposed method achieves comparatively more noise suppression without distorting the audio.
引用
收藏
页码:56798 / 56810
页数:13
相关论文
共 36 条
  • [1] SPATIAL FILTERING BASED SPEECH ENHANCEMENT FOR BINAURAL HEARING AID
    Daoud, Dhouha
    Kallel, Fathi
    Ghorbel, Mohamed
    Ben Hamida, Ahmed
    2009 6TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS AND DEVICES, VOLS 1 AND 2, 2009, : 671 - 676
  • [2] A Deep Learning Speech Enhancement Architecture Optimised for Speech Recognition and Hearing Aids
    Nossier, Soha A.
    Wall, Julie
    Moniri, Mansour
    Glackin, Cornelius
    Cannings, Nigel
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 553 - 558
  • [3] A Smart Binaural Hearing Aid Architecture Based on a Mobile Computing Platform
    Li, Yingdan
    Chen, Fei
    Sun, Zhuoyi
    Weng, Zhaoyang
    Tang, Xian
    Jiang, Hanjun
    Wang, Zhihua
    ELECTRONICS, 2019, 8 (07)
  • [4] A Supervised Speech Enhancement Method for Smartphone-Based Binaural Hearing Aids
    Sun, Zhuoyi
    Li, Yingdan
    Jiang, Hanjun
    Chen, Fei
    Xie, Xiang
    Wang, Zhihua
    IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2020, 14 (05) : 951 - 960
  • [5] An RNN-based Speech Enhancement Method for a Binaural Hearing Aid System
    Sun, Zhuoyi
    Li, Yingdan
    Jiang, Hanjun
    Wang, Zhihua
    2019 17TH IEEE INTERNATIONAL NEW CIRCUITS AND SYSTEMS CONFERENCE (NEWCAS), 2019,
  • [6] System Architecture of a Smart Binaural Hearing Aid Using a Mobile Computing Platform
    Li, Yingdan
    Chen, Fei
    Sun, Zhuoyi
    Weng, Zhaoyang
    Tang, Xian
    Jiang, Hanjun
    Wang, Zhihua
    2017 IEEE 12TH INTERNATIONAL CONFERENCE ON ASIC (ASICON), 2017, : 440 - 443
  • [7] A BINAURAL HEARING AID SPEECH ENHANCEMENT METHOD MAINTAINING SPATIAL AWARENESS FOR THE USER
    Thiemann, Joachim
    Miller, Menno
    van de Par, Steven
    2014 PROCEEDINGS OF THE 22ND EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2014, : 321 - 325
  • [8] Deep Neural Network Based Noised Asian Speech Enhancement and Its Implementation on a Hearing Aid App
    Fan, Xiaoqian
    Yang, Bowen
    Chen, Wenzhi
    Fan, Quanfang
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (05)
  • [9] Binaural speech enhancement algorithm based on attention and deep learning
    Li R.
    Li Q.
    Zhao F.
    Liu S.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2023, 51 (09): : 125 - 131and166
  • [10] Convolutional Recurrent Smart Speech Enhancement Architecture for Hearing Aids
    Nossier, Soha A.
    Wall, Julie
    Moniri, Mansour
    Glackin, Cornelius
    Cannings, Nigel
    INTERSPEECH 2022, 2022, : 5428 - 5432