DETECTING ALZHEIMER'S DISEASE FROM SPEECH USING NEURAL NETWORKS WITH BOTTLENECK FEATURES AND DATA AUGMENTATION

被引:14
|
作者
Liu, Zhaoci [1 ]
Guo, Zhiqiang [1 ]
Ling, Zhenhua [1 ]
Li, Yunxia [2 ]
机构
[1] Univ Sci & Technol China, Natl Engn Lab Speech & Language Informat Proc, Hefei, Peoples R China
[2] Tongji Univ, Shanghai Tongji Hosp, Sch Med, Shanghai, Peoples R China
关键词
Alzheimer's disease; speech analysis; neural networks; bottleneck features; data augmentation; AUTOMATIC DIAGNOSIS;
D O I
10.1109/ICASSP39728.2021.9413566
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper presents a method of detecting Alzheimer's disease (AD) from the spontaneous speech of subjects in a picture description task using neural networks. This method does not rely on the manual transcriptions and annotations of a subject's speech, but utilizes the bottleneck features extracted from audio using an ASR model. The neural network contains convolutional neural network (CNN) layers for local context modeling, bidirectional long short-term memory (BiLSTM) layers for global context modeling and an attention pooling layer for classification. Furthermore, a masking-based data augmentation method is designed to deal with the data scarcity problem. Experiments on the DementiaBank dataset show that the detection accuracy of our proposed method is 82.59%, which is better than the baseline method based on manually-designed acoustic features and support vector machines (SVM), and achieves the state-of-the-art performance of detecting AD using only audio data on this dataset.
引用
收藏
页码:7323 / 7327
页数:5
相关论文
共 50 条
  • [1] Detecting Alzheimer's Disease using Interactional and Acoustic features from spontaneous speech
    Nasreen, Shamila
    Hough, Julian
    Purver, Matthew
    [J]. INTERSPEECH 2021, 2021, : 1962 - 1966
  • [2] Efficient deep neural networks for speech synthesis using bottleneck features
    Joo, Young-Sun
    Jun, Won-Suk
    Kang, Hong-Goo
    [J]. 2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [3] Speech Bandwidth Extension Using Bottleneck Features and Deep Recurrent Neural Networks
    Gu, Yu
    Ling, Zhen-Hua
    Dai, Li-Rong
    [J]. 17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 297 - 301
  • [4] Detecting Alzheimer's Disease Using Gated Convolutional Neural Network from Audio Data
    Warnita, Tifani
    Inoue, Nakamasa
    Shinoda, Koichi
    [J]. 19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 1706 - 1710
  • [5] Detecting Alzheimer's Disease from Continuous Speech Using Language Models
    Guo, Zhiqiang
    Ling, Zhenhua
    Li, Yunxia
    [J]. JOURNAL OF ALZHEIMERS DISEASE, 2019, 70 (04) : 1163 - 1174
  • [6] Artificial Neural Networks in the Discrimination of Alzheimer's disease Using Biomarkers Data
    Aljovic, Almir
    Badnjevic, Almir
    Gurbeta, Lejla
    [J]. 2016 5TH MEDITERRANEAN CONFERENCE ON EMBEDDED COMPUTING (MECO), 2016, : 286 - 289
  • [7] Alzheimer's disease diagnosis framework from incomplete multimodal data using convolutional neural networks
    Abdelaziz, Mohammed
    Wang, Tianfu
    Elazab, Ahmed
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2021, 121
  • [8] USING NEURAL NETWORKS TO SIMULATE THE ALZHEIMER'S DISEASE
    Monteiro, Julio L. R.
    Netto, Marcio Lobo
    Andina, Diego
    Pelaez, Javier Ropero
    [J]. 2008 WORLD AUTOMATION CONGRESS PROCEEDINGS, VOLS 1-3, 2008, : 712 - +
  • [9] Analysis of Postural Kinetics data using Artificial Neural Networks in Alzheimer's Disease
    Ferreira, Jaime
    Gago, Miguel F.
    Fernandes, Vitor
    Silva, Helder
    Sousa, Nuno
    Rocha, Luis
    Bicho, Estela
    [J]. 2014 IEEE INTERNATIONAL SYMPOSIUM ON MEDICAL MEASUREMENTS AND APPLICATIONS (MEMEA), 2014, : 108 - 113
  • [10] Classification of Alzheimer's disease using robust TabNet neural networks on genetic data
    Jin, Yu
    Ren, Zhe
    Wang, Wenjie
    Zhang, Yulei
    Zhou, Liang
    Yao, Xufeng
    Wu, Tao
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (05) : 8358 - 8374