An Assessment of Paralinguistic Acoustic Features for Detection of Alzheimer's Dementia in Spontaneous Speech

被引:93
|
作者
Haider, Fasih [1 ]
de la Fuente, Sofia [1 ]
Luz, Saturnino [1 ]
机构
[1] Univ Edinburgh, Edinburgh Med Sch, Usher Inst Populat Hlth Sci & Informat, Edinburgh EH8 9YL, Midlothian, Scotland
基金
英国医学研究理事会; 欧盟地平线“2020”;
关键词
Feature extraction; Alzheimer's disease; Acoustics; Task analysis; Semantics; Affective computing; social signal processing; dementia; Alzheimer; cognitive decline detection; cognitive imp-airment detection; PICTURE DESCRIPTION; DISEASE; LANGUAGE; HYPOTHESIS; DIAGNOSIS; BATTERY; HISTORY;
D O I
10.1109/JSTSP.2019.2955022
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Speech analysis could provide an indicator of Alzheimer's disease and help develop clinical tools for automatically detecting and monitoring disease progression. While previous studies have employed acoustic (speech) features for characterisation of Alzheimer's dementia, these studies focused on a few common prosodic features, often in combination with lexical and syntactic features which require transcription. We present a detailed study of the predictive value of purely acoustic features automatically extracted from spontaneous speech for Alzheimer's dementia detection, from a computational paralinguistics perspective. The effectiveness of several state-of-the-art paralinguistic feature sets for Alzheimer's detection were assessed on a balanced sample of DementiaBank's Pitt spontaneous speech dataset, with patients matched by gender and age. The feature sets assessed were the extended Geneva minimalistic acoustic parameter set (eGeMAPS), the emobase feature set, the ComParE 2013 feature set, and new Multi-Resolution Cochleagram (MRCG) features. Furthermore, we introduce a new active data representation (ADR) method for feature extraction in Alzheimer's dementia recognition. Results show that classification models based solely on acoustic speech features extracted through our ADR method can achieve accuracy levels comparable to those achieved by models that employ higher-level language features. Analysis of the results suggests that all feature sets contribute information not captured by other feature sets. We show that while the eGeMAPS feature set provides slightly better accuracy than other feature sets individually (71.34%), "hard fusion" of feature sets improves accuracy to 78.70%.
引用
收藏
页码:272 / 281
页数:10
相关论文
共 50 条
  • [1] Acoustic and Language Based Deep Learning Approaches for Alzheimer's Dementia Detection From Spontaneous Speech
    Mahajan, Pranav
    Baths, Veeky
    [J]. FRONTIERS IN AGING NEUROSCIENCE, 2021, 13
  • [2] Paralinguistic and linguistic fluency features for Alzheimer's disease detection
    Campbell, Edward L.
    Mesia, Raul Yanez
    Docio-Fernandez, Laura
    Garcia-Mateo, Carmen
    [J]. COMPUTER SPEECH AND LANGUAGE, 2021, 68
  • [3] Alzheimer's Dementia Recognition From Spontaneous Speech Using Disfluency and Interactional Features
    Nasreen, Shamila
    Rohanian, Morteza
    Hough, Julian
    Purver, Matthew
    [J]. FRONTIERS IN COMPUTER SCIENCE, 2021, 3
  • [4] Detecting Alzheimer's Disease using Interactional and Acoustic features from spontaneous speech
    Nasreen, Shamila
    Hough, Julian
    Purver, Matthew
    [J]. INTERSPEECH 2021, 2021, : 1962 - 1966
  • [5] Predicting Mini-Mental Status Examination Scores through Paralinguistic Acoustic Features of Spontaneous Speech
    Fu, Ziyang
    Haider, Fasih
    Luz, Saturnino
    [J]. 42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 5548 - 5552
  • [6] Longitudinal Monitoring and Detection of Alzheimer's Type Dementia from Spontaneous Speech Data
    Luz, Saturnino
    [J]. 2017 IEEE 30TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2017, : 45 - 46
  • [7] Temporal Integration of Text Transcripts and Acoustic Features for Alzheimer's Diagnosis Based on Spontaneous Speech
    Martinc, Matej
    Haider, Fasih
    Pollak, Senja
    Luz, Saturnino
    [J]. FRONTIERS IN AGING NEUROSCIENCE, 2021, 13
  • [8] Using the Outputs of Different Automatic Speech Recognition Paradigms for Acoustic- and BERT-based Alzheimer's Dementia Detection through Spontaneous Speech
    Pan, Yilin
    Mirheidari, Bahman
    Harris, Jennifer M.
    Thompson, Jennifer C.
    Jones, Matthew
    Snowden, Julie S.
    Blackburn, Daniel
    Christensen, Heidi
    [J]. INTERSPEECH 2021, 2021, : 3810 - 3814
  • [9] Automated Screening for Alzheimer's Dementia through Spontaneous Speech
    Syed, Muhammad Shehram Shah
    Syed, Zafi Sherhan
    Lech, Margaret
    Pirogova, Elena
    [J]. INTERSPEECH 2020, 2020, : 2222 - 2226
  • [10] Editorial: Alzheimer's Dementia Recognition through Spontaneous Speech
    Luz, Saturnino
    Haider, Fasih
    de la Fuente Garcia, Sofia
    Fromm, Davida
    MacWhinney, Brian
    [J]. FRONTIERS IN COMPUTER SCIENCE, 2021, 3