A novel multi-modal machine learning based approach for automatic classification of EEG recordings in dementia

被引:170
|
作者
Ieracitano, Cosimo [1 ]
Mammone, Nadia [2 ]
Hussain, Amir [3 ]
Morabito, Francesco C. [1 ]
机构
[1] Univ Mediterranea Reggio Calabria, DICEAM, Via Graziella, I-89060 Reggio Di Calabria, Italy
[2] IRCCS Ctr Neurolesi Bonino Pulejo, Via Palermo C Casazza,SS 113, I-98124 Messina, Italy
[3] Edinburgh Napier Univ, Sch Comp, Edinburgh EH10 5DT, Midlothian, Scotland
基金
英国工程与自然科学研究理事会;
关键词
Machine learning; Continuous wavelet transform; Bispectrum; Alzheimer's disease; Mild cognitive impairment; Data fusion; MILD COGNITIVE IMPAIRMENT; ALZHEIMERS-DISEASE; DIAGNOSIS; DYNAMICS;
D O I
10.1016/j.neunet.2019.12.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalographic (EEG) recordings generate an electrical map of the human brain that are useful for clinical inspection of patients and in biomedical smart Internet-of-Things (IoT) and BrainComputer Interface (BCI) applications. From a signal processing perspective, EEGs yield a nonlinear and nonstationary, multivariate representation of the underlying neural circuitry interactions. In this paper, a novel multi-modal Machine Learning (ML) based approach is proposed to integrate EEG engineered features for automatic classification of brain states. EEGs are acquired from neurological patients with Mild Cognitive Impairment (MCI) or Alzheimer's disease (AD) and the aim is to discriminate Healthy Control (HC) subjects from patients. Specifically, in order to effectively cope with nonstationarities, 19-channels EEG signals are projected into the time-frequency (TF) domain by means of the Continuous Wavelet Transform (CWT) and a set of appropriate features (denoted as CWT features) are extracted from delta, theta, alpha(1), alpha(2), beta EEG sub-bands. Furthermore, to exploit nonlinear phase-coupling information of EEG signals, higher order statistics (HOS) are extracted from the bispectrum (BiS) representation. BiS generates a second set of features (denoted as BiS features) which are also evaluated in the five EEG sub-bands. The CWT and BiS features are fed into a number of ML classifiers to perform both 2-way (AD vs. HC, AD vs. MCI, MCI vs. HC) and 3-way (AD vs. MCI vs. HC) classifications. As an experimental benchmark, a balanced EEG dataset that includes 63 AD, 63 MCI and 63 HC is analyzed. Comparative results show that when the concatenation of CWT and BiS features (denoted as multimodal (CWT+BiS) features) is used as input, the Multi-Layer Perceptron (MLP) classifier outperforms all other models, specifically, the Autoencoder (AE), Logistic Regression (LR) and Support Vector Machine (SVM). Consequently, our proposed multi-modal ML scheme can be considered a viable alternative to state-of-the-art computationally intensive deep learning approaches. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:176 / 190
页数:15
相关论文
共 50 条
  • [21] A multi-modal wildfire prediction and early-warning system based on a novel machine learning framework
    Bhowmik, Rohan T.
    Jung, Youn Soo
    Aguilera, Juan A.
    Prunicki, Mary
    Nadeau, Kari
    [J]. JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2023, 341
  • [22] Deep Learning-Based Multi-Modal Ensemble Classification Approach for Human Breast Cancer Prognosis
    Jadoon, Ehtisham Khan
    Khan, Fiaz Gul
    Shah, Sajid
    Khan, Ahmad
    ElAffendi, Muhammed
    [J]. IEEE ACCESS, 2023, 11 : 85760 - 85769
  • [23] ELEMENT: Multi-Modal Retinal Vessel Segmentation Based on a Coupled Region Growing and Machine Learning Approach
    Rodrigues, Erick
    Conci, Aura
    Liatsis, Panos
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (12) : 3507 - 3519
  • [24] A MULTI-MODAL TRANSFORMER APPROACH FOR FOOTBALL EVENT CLASSIFICATION
    Zhang, Yixiao
    Li, Baihua
    Fang, Hui
    Meng, Qinggang
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2220 - 2224
  • [25] A multi-modal approach for activity classification and fall detection
    Carlos Castillo, Jose
    Carneiro, Davide
    Serrano-Cuerda, Juan
    Novais, Paulo
    Fernandez-Caballero, Antonio
    Neves, Jose
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2014, 45 (04) : 810 - 824
  • [26] Multi-Modal Multi-Task Learning for Automatic Dietary Assessment
    Liu, Qi
    Zhang, Yue
    Liu, Zhenguang
    Yuan, Ye
    Cheng, Li
    Zimmermann, Roger
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 2347 - 2354
  • [27] CNN-Based Fully Automatic Glioma Classification with Multi-modal Medical Images
    Zhao, Bingchao
    Huang, Jia
    Liang, Changhong
    Liu, Zaiyi
    Han, Chu
    [J]. BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES (BRAINLES 2020), PT II, 2021, 12659 : 497 - 507
  • [28] Transformer-based Automatic Music Mood Classification Using Multi-modal Framework
    Kumar, Sujeesha Ajithakumari Suresh
    Rajan, Rajeev
    [J]. JOURNAL OF COMPUTER SCIENCE & TECHNOLOGY, 2023, 23 (01): : 18 - 34
  • [29] Multi-Modal Game Based Learning: Satisfaction and Users Achievement Approach
    Ayad, Khaled
    Rigas, Dimitrios
    [J]. SEPADS'10: PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, PARALLEL AND DISTRIBUTED SYSTEMS, 2010, : 166 - 171
  • [30] MPCM: Multi-modal User Portrait Classification Model Based on Collaborative Learning
    Liu, Jinhang
    Li, Lin
    [J]. INFORMATION TECHNOLOGY AND CONTROL, 2023, 52 (04): : 867 - 877