DETECTING ALZHEIMER'S DISEASE FROM SPEECH USING NEURAL NETWORKS WITH BOTTLENECK FEATURES AND DATA AUGMENTATION

被引:14
|
作者
Liu, Zhaoci [1 ]
Guo, Zhiqiang [1 ]
Ling, Zhenhua [1 ]
Li, Yunxia [2 ]
机构
[1] Univ Sci & Technol China, Natl Engn Lab Speech & Language Informat Proc, Hefei, Peoples R China
[2] Tongji Univ, Shanghai Tongji Hosp, Sch Med, Shanghai, Peoples R China
关键词
Alzheimer's disease; speech analysis; neural networks; bottleneck features; data augmentation; AUTOMATIC DIAGNOSIS;
D O I
10.1109/ICASSP39728.2021.9413566
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper presents a method of detecting Alzheimer's disease (AD) from the spontaneous speech of subjects in a picture description task using neural networks. This method does not rely on the manual transcriptions and annotations of a subject's speech, but utilizes the bottleneck features extracted from audio using an ASR model. The neural network contains convolutional neural network (CNN) layers for local context modeling, bidirectional long short-term memory (BiLSTM) layers for global context modeling and an attention pooling layer for classification. Furthermore, a masking-based data augmentation method is designed to deal with the data scarcity problem. Experiments on the DementiaBank dataset show that the detection accuracy of our proposed method is 82.59%, which is better than the baseline method based on manually-designed acoustic features and support vector machines (SVM), and achieves the state-of-the-art performance of detecting AD using only audio data on this dataset.
引用
收藏
页码:7323 / 7327
页数:5
相关论文
共 50 条
  • [31] Throwing Darts in the Dark? Detecting Bots with Limited Data using Neural Data Augmentation
    Jan, Steve T. K.
    Hao, Qingying
    Hu, Tianrui
    Pu, Jiameng
    Oswal, Sonal
    Wang, Gang
    Viswanath, Bimal
    [J]. 2020 IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP 2020), 2020, : 1190 - 1206
  • [32] Alzheimer's Disease Detection Using Ensemble Learning and Artificial Neural Networks
    Bandyopadhyay, Ahana
    Ghosh, Sourodip
    Bose, Moinak
    Singh, Arun
    Othmani, Alice
    Santosh, K. C.
    [J]. RECENT TRENDS IN IMAGE PROCESSING AND PATTERN RECOGNITION, RTIP2R 2022, 2023, 1704 : 12 - 21
  • [33] Individualized Diagnosis of Preclinical Alzheimer's Disease using Deep Neural Networks
    Park, Jinhee
    Jang, Sehyeon
    Gwak, Jeonghwan
    Kim, Byeong C.
    Lee, Jang Jae
    Choi, Kyu Yeong
    Lee, Kun Ho
    Jun, Sung Chan
    Jang, Gil-Jin
    Ahn, Sangtae
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
  • [34] Alzheimer's disease detection using depthwise separable convolutional neural networks
    Liu, Junxiu
    Li, Mingxing
    Luo, Yuling
    Yang, Su
    Li, Wei
    Bi, Yifei
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 203
  • [35] Predicting Alzheimer's disease progression using deep recurrent neural networks
    Minh Nguyen
    He, Tong
    An, Lijun
    Alexander, Daniel C.
    Feng, Jiashi
    Yeo, B. T. Thomas
    [J]. NEUROIMAGE, 2020, 222
  • [36] Three Class Classification of Alzheimer's Disease Using Deep Neural Networks
    Shah, Deep R.
    Kapdi, Rupal A.
    Patel, Jigna S.
    Patel, Jitali
    [J]. CURRENT MEDICAL IMAGING, 2023, 19 (08) : 855 - 864
  • [37] Detecting Periodontal Disease Using Convolutional Neural Networks
    Aberin, Shannah Therese A.
    de Goma, Joel C.
    [J]. 2018 IEEE 10TH INTERNATIONAL CONFERENCE ON HUMANOID, NANOTECHNOLOGY, INFORMATION TECHNOLOGY, COMMUNICATION AND CONTROL, ENVIRONMENT AND MANAGEMENT (HNICEM), 2018,
  • [38] Data augmentation using generative adversarial networks for robust speech recognition
    Qian, Yanmin
    Hu, Hu
    Tan, Tian
    [J]. SPEECH COMMUNICATION, 2019, 114 : 1 - 9
  • [39] ENTRAINMENT ANALYSIS FOR ASSESSMENT OF AUTISTIC SPEECH PROSODY USING BOTTLENECK FEATURES OF DEEP NEURAL NETWORK
    Ochi, Keiko
    Ono, Nobutaka
    Owada, Keiho
    Kuroda, Miho
    Sagayama, Shigeki
    Yamasue, Hidenori
    [J]. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2022, 2022-May : 8492 - 8496
  • [40] Biomedical Data Augmentation Using Generative Adversarial Neural Networks
    Calimeri, Francesco
    Marzullo, Aldo
    Stamile, Claudio
    Terracina, Giorgio
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, PT II, 2017, 10614 : 626 - 634