A novel multi-modal machine learning based approach for automatic classification of EEG recordings in dementia

被引:170
|
作者
Ieracitano, Cosimo [1 ]
Mammone, Nadia [2 ]
Hussain, Amir [3 ]
Morabito, Francesco C. [1 ]
机构
[1] Univ Mediterranea Reggio Calabria, DICEAM, Via Graziella, I-89060 Reggio Di Calabria, Italy
[2] IRCCS Ctr Neurolesi Bonino Pulejo, Via Palermo C Casazza,SS 113, I-98124 Messina, Italy
[3] Edinburgh Napier Univ, Sch Comp, Edinburgh EH10 5DT, Midlothian, Scotland
基金
英国工程与自然科学研究理事会;
关键词
Machine learning; Continuous wavelet transform; Bispectrum; Alzheimer's disease; Mild cognitive impairment; Data fusion; MILD COGNITIVE IMPAIRMENT; ALZHEIMERS-DISEASE; DIAGNOSIS; DYNAMICS;
D O I
10.1016/j.neunet.2019.12.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalographic (EEG) recordings generate an electrical map of the human brain that are useful for clinical inspection of patients and in biomedical smart Internet-of-Things (IoT) and BrainComputer Interface (BCI) applications. From a signal processing perspective, EEGs yield a nonlinear and nonstationary, multivariate representation of the underlying neural circuitry interactions. In this paper, a novel multi-modal Machine Learning (ML) based approach is proposed to integrate EEG engineered features for automatic classification of brain states. EEGs are acquired from neurological patients with Mild Cognitive Impairment (MCI) or Alzheimer's disease (AD) and the aim is to discriminate Healthy Control (HC) subjects from patients. Specifically, in order to effectively cope with nonstationarities, 19-channels EEG signals are projected into the time-frequency (TF) domain by means of the Continuous Wavelet Transform (CWT) and a set of appropriate features (denoted as CWT features) are extracted from delta, theta, alpha(1), alpha(2), beta EEG sub-bands. Furthermore, to exploit nonlinear phase-coupling information of EEG signals, higher order statistics (HOS) are extracted from the bispectrum (BiS) representation. BiS generates a second set of features (denoted as BiS features) which are also evaluated in the five EEG sub-bands. The CWT and BiS features are fed into a number of ML classifiers to perform both 2-way (AD vs. HC, AD vs. MCI, MCI vs. HC) and 3-way (AD vs. MCI vs. HC) classifications. As an experimental benchmark, a balanced EEG dataset that includes 63 AD, 63 MCI and 63 HC is analyzed. Comparative results show that when the concatenation of CWT and BiS features (denoted as multimodal (CWT+BiS) features) is used as input, the Multi-Layer Perceptron (MLP) classifier outperforms all other models, specifically, the Autoencoder (AE), Logistic Regression (LR) and Support Vector Machine (SVM). Consequently, our proposed multi-modal ML scheme can be considered a viable alternative to state-of-the-art computationally intensive deep learning approaches. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:176 / 190
页数:15
相关论文
共 50 条
  • [1] Multi-modal Machine Learning Model for Interpretable Malware Classification
    Lisa, Fahmida Tasnim
    Islam, Sheikh Rabiul
    Kumar, Neha Mohan
    [J]. EXPLAINABLE ARTIFICIAL INTELLIGENCE, PT III, XAI 2024, 2024, 2155 : 334 - 349
  • [2] Automatic Sleep Stage Classification Applying Machine Learning Algorithms on EEG Recordings
    Chriskos, Panteleimon
    Kaitalidou, Dimitra S.
    Karakasis, Georgios
    Frantzidis, Christos
    Gkivogkli, Polyxeni T.
    Bamidis, Panagiotis
    Kourtidou-Papadeli, Chrysoula
    [J]. 2017 IEEE 30TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2017, : 435 - 439
  • [3] A Multiple Kernel Learning Approach to Multi-Modal Pedestrian Classification
    San-Biagio, Marco
    Ulas, Aydin
    Crocco, Marco
    Cristani, Marco
    Castellani, Umberto
    Murino, Vittorio
    [J]. 2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 2412 - 2415
  • [4] A multi-modal, multi-atlas-based approach for Alzheimer detection via machine learning
    Asim, Yousra
    Raza, Basit
    Malik, Ahmad Kamran
    Rathore, Saima
    Hussain, Lal
    Iftikhar, Mohammad Aksam
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2018, 28 (02) : 113 - 123
  • [5] MULTI-MODAL APPROACH TO INDEXING AND CLASSIFICATION
    SWIFT, DF
    WINN, VA
    BRAMER, DA
    [J]. INTERNATIONAL CLASSIFICATION, 1977, 4 (02): : 90 - 94
  • [6] An Improved Multi-Modal based Machine Learning Approach for the Prognosis of Alzheimer?s disease
    Khan, Afreen
    Zubair, Swaleha
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (06) : 2688 - 2706
  • [7] Machine Learning Based Multi-Modal Transportation Network Planner
    Manghat, Neeraj Menon
    Gopalakrishna, Vaishak
    Bonthu, Sai
    Hunt, Victor
    Helmicki, Arthur
    McClintock, Doug
    [J]. INTERNATIONAL CONFERENCE ON TRANSPORTATION AND DEVELOPMENT 2024: TRANSPORTATION SAFETY AND EMERGING TECHNOLOGIES, ICTD 2024, 2024, : 380 - 389
  • [8] MM-Net: A Multi-Modal Approach Toward Automatic Modulation Classification
    Triaridis, Konstantinos
    Doumanidis, Constantine
    Chatzidiamantis, Nestor D.
    Karagiannidis, George K.
    [J]. IEEE COMMUNICATIONS LETTERS, 2024, 28 (02) : 328 - 331
  • [9] A multi-modal machine learning approach towards predicting patient readmission
    Mohanty, Somya D.
    Lekan, Deborah
    McCoy, Thomas P.
    Jenkins, Marjorie
    Manda, Prashanti
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 2027 - 2035
  • [10] Multi-modal biomarkers of low back pain: A machine learning approach
    Lamichhane, Bidhan
    Jayasekera, Dinal
    Jakes, Rachel
    Glasser, Matthew F.
    Zhang, Justin
    Yang, Chunhui
    Grimes, Derayvia
    Frank, Tyler L.
    Ray, Wilson Z.
    Leuthardt, Eric C.
    Hawasli, Ammar H.
    [J]. NEUROIMAGE-CLINICAL, 2021, 29