An Assessment of Paralinguistic Acoustic Features for Detection of Alzheimer's Dementia in Spontaneous Speech

被引:93
|
作者
Haider, Fasih [1 ]
de la Fuente, Sofia [1 ]
Luz, Saturnino [1 ]
机构
[1] Univ Edinburgh, Edinburgh Med Sch, Usher Inst Populat Hlth Sci & Informat, Edinburgh EH8 9YL, Midlothian, Scotland
基金
英国医学研究理事会; 欧盟地平线“2020”;
关键词
Feature extraction; Alzheimer's disease; Acoustics; Task analysis; Semantics; Affective computing; social signal processing; dementia; Alzheimer; cognitive decline detection; cognitive imp-airment detection; PICTURE DESCRIPTION; DISEASE; LANGUAGE; HYPOTHESIS; DIAGNOSIS; BATTERY; HISTORY;
D O I
10.1109/JSTSP.2019.2955022
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Speech analysis could provide an indicator of Alzheimer's disease and help develop clinical tools for automatically detecting and monitoring disease progression. While previous studies have employed acoustic (speech) features for characterisation of Alzheimer's dementia, these studies focused on a few common prosodic features, often in combination with lexical and syntactic features which require transcription. We present a detailed study of the predictive value of purely acoustic features automatically extracted from spontaneous speech for Alzheimer's dementia detection, from a computational paralinguistics perspective. The effectiveness of several state-of-the-art paralinguistic feature sets for Alzheimer's detection were assessed on a balanced sample of DementiaBank's Pitt spontaneous speech dataset, with patients matched by gender and age. The feature sets assessed were the extended Geneva minimalistic acoustic parameter set (eGeMAPS), the emobase feature set, the ComParE 2013 feature set, and new Multi-Resolution Cochleagram (MRCG) features. Furthermore, we introduce a new active data representation (ADR) method for feature extraction in Alzheimer's dementia recognition. Results show that classification models based solely on acoustic speech features extracted through our ADR method can achieve accuracy levels comparable to those achieved by models that employ higher-level language features. Analysis of the results suggests that all feature sets contribute information not captured by other feature sets. We show that while the eGeMAPS feature set provides slightly better accuracy than other feature sets individually (71.34%), "hard fusion" of feature sets improves accuracy to 78.70%.
引用
收藏
页码:272 / 281
页数:10
相关论文
共 50 条
  • [21] Automatic detection and rating of dementia of Alzheimer type through lexical analysis of spontaneous speech
    Thomas, Calvin
    Keselj, Vlado
    Cercone, Nick
    Rockwood, Kenneth
    Asp, Elissa
    2005 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATIONS, VOLS 1-4, CONFERENCE PROCEEDINGS, 2005, : 1569 - 1574
  • [22] Filled Pauses and Lengthenings Detection Based on the Acoustic Features for the Spontaneous Russian Speech
    Verkhodanova, Vasilisa
    Shapranov, Vladimir
    SPEECH AND COMPUTER, 2014, 8773 : 227 - 234
  • [23] Automatic Detection of Alzheimer's Disease Using Spontaneous Speech Only
    Chen, Jun
    Ye, Jieping
    Tang, Fengyi
    Zhou, Jiayu
    INTERSPEECH 2021, 2021, : 3830 - 3834
  • [24] Dementia Detection by Analyzing Spontaneous Mandarin Speech
    Liu, Zhaoci
    Guo, Zhiqiang
    Ling, Zhenhua
    Wang, Shijin
    Jin, Lingjing
    Li, Yunxia
    2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 289 - 296
  • [25] Distinguishable features of spontaneous speech in Alzheimer's clinical syndrome and healthy controls
    Burke, Erin
    Gunstad, John
    Pavlenko, Olesia
    Hamrick, Phillip
    AGING NEUROPSYCHOLOGY AND COGNITION, 2024, 31 (03) : 575 - 586
  • [26] Comparing Natural Language Processing Techniques for Alzheimer's Dementia Prediction in Spontaneous Speech
    Searle, Thomas
    Ibrahim, Zina
    Dobson, Richard
    INTERSPEECH 2020, 2020, : 2192 - 2196
  • [27] Limited connectedness of spontaneous speech may be a marker of dementia due to Alzheimer's disease
    Botezatu, Mona Roxana
    Miller, Erika
    Kiselica, Andrew M.
    FRONTIERS IN AGING NEUROSCIENCE, 2023, 15
  • [28] Analysis of acoustic-prosodic features related to paralinguistic information carried by interjections in dialogue speech
    Ishi, Carlos T.
    Ishiguro, Hiroshi
    Hagita, Norihiro
    12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 3140 - +
  • [29] Hesitations in Spontaneous Speech: Acoustic Analysis and Detection
    Verkhodanova, Vasilisa
    Shapranov, Vladimir
    Kipyatkova, Irina
    SPEECH AND COMPUTER, SPECOM 2017, 2017, 10458 : 398 - 406
  • [30] Natural Language Features for Detection of Alzheimer's Disease in Conversational Speech
    Khodabakhsh, Ali
    Kuscuoglu, Serhan
    Demiroglu, Cenk
    2014 IEEE-EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL AND HEALTH INFORMATICS (BHI), 2014, : 581 - 584