A Review of Automated Speech-Based Interaction for Cognitive Screening

被引:1
|
作者
Boletsis, Costas [1 ]
机构
[1] SINTEF Digital, Forskningsveien 1, N-0373 Oslo, Norway
关键词
artificial intelligence; cognitive screening; dementia; speech analysis; speech-based interaction; speech recognition; WEB-OF-SCIENCE; GOOGLE-SCHOLAR; SERIOUS GAME; IMPAIRMENT; RECOGNITION; SCOPUS; SKILLS;
D O I
10.3390/mti4040093
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Language, speech and conversational behaviours reflect cognitive changes that may precede physiological changes and offer a much more cost-effective option for detecting preclinical cognitive decline. Artificial intelligence and machine learning have been established as a means to facilitate automated speech-based cognitive screening through automated recording and analysis of linguistic, speech and conversational behaviours. In this work, a scoping literature review was performed to document and analyse current automated speech-based implementations for cognitive screening from the perspective of human-computer interaction. At this stage, the goal was to identify and analyse the characteristics that define the interaction between the automated speech-based screening systems and the users, potentially revealing interaction-related patterns and gaps. In total, 65 articles were identified as appropriate for inclusion, from which 15 articles satisfied the inclusion criteria. The literature review led to the documentation and further analysis of five interaction-related themes: (i) user interface, (ii) modalities, (iii) speech-based communication, (iv) screening content and (v) screener. Cognitive screening through speech-based interaction might benefit from two practices: (1) implementing more multimodal user interfaces that facilitate-amongst others-speech-based screening and (2) introducing the element of motivation in the speech-based screening process.
引用
收藏
页码:1 / 9
页数:9
相关论文
共 50 条
  • [1] Speech-Based Automated Cognitive Status Assessment
    Hakkani-Tuer, Dilek
    Vergyri, Dimitra
    Tur, Gokhan
    [J]. 11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 1-2, 2010, : 258 - +
  • [2] Fully automated speech-based frontline screening for dementia
    Troger, J.
    Linz, N.
    Konig, A.
    Peter, J.
    Alexandersson, J.
    Robert, P.
    [J]. EUROPEAN PSYCHIATRY, 2018, 48 : S132 - S132
  • [3] Automated speech-based screening of depression using deep convolutional neural networks
    Chlasta, Karol
    Wolk, Krzysztof
    Krejtz, Izabela
    [J]. CENTERIS2019--INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS/PROJMAN2019--INTERNATIONAL CONFERENCE ON PROJECT MANAGEMENT/HCIST2019--INTERNATIONAL CONFERENCE ON HEALTH AND SOCIAL CARE INFORMATION SYSTEMS AND TECHNOLOGIES, 2019, 164 : 618 - 628
  • [4] Speech-Based Automated Cognitive Impairment Detection From Remotely-Collected Cognitive Test Audio
    Yu, Bea
    Williamson, James R.
    Mundt, James C.
    Quatieri, Thomas F.
    [J]. IEEE ACCESS, 2018, 6 : 40494 - 40505
  • [5] Speech-based cognitive load monitoring system
    Yin, Bo
    Chen, Fang
    Ruiz, Natalie
    Ambikairajah, Eliathamby
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 2041 - 2044
  • [6] A review of speech-based bimodal recognition
    Chibelushi, CC
    Deravi, F
    Mason, JSD
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2002, 4 (01) : 23 - 37
  • [7] Speech-based Interaction: Myths, Challenges, and Opportunities
    Munteanu, Cosmin
    Penn, Gerald
    [J]. PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES (MOBILEHCI'14), 2014, : 567 - 568
  • [8] GLOTTAL FEATURES FOR SPEECH-BASED COGNITIVE LOAD CLASSIFICATION
    Yap, Tet Fei
    Epps, Julien
    Choi, Eric H. C.
    Ambikairajah, Eliathamby
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 5234 - 5237
  • [9] Toward a quizmaster robot for speech-based multiparty interaction
    Nishimuta, Izaya
    Itoyama, Katsutoshi
    Yoshii, Kazuyoshi
    Okuno, Hiroshi G.
    [J]. ADVANCED ROBOTICS, 2015, 29 (18) : 1205 - 1219
  • [10] Designing habitable dialogues for speech-based interaction with computers
    Hone, KS
    Baber, C
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2001, 54 (04) : 637 - 662