Transfer Learning to Detect Parkinson's Disease from Speech In Different Languages Using Convolutional Neural Networks with Layer Freezing

被引:8
|
作者
David Rios-Urrego, Cristian [1 ]
Camilo Vasquez-Correa, Juan [1 ,2 ]
Rafael Orozco-Arroyave, Juan [1 ,2 ]
Noeth, Elmar [2 ]
机构
[1] Univ Antioquia UdeA, Fac Engn, Medellin, Colombia
[2] Friedrich Alexander Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
来源
基金
欧盟地平线“2020”;
关键词
Parkinson's disease; Speech processing; Transfer Learning; Convolutional neural networks;
D O I
10.1007/978-3-030-58323-1_36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's Disease is a neurodegenerative disorder characterized by motor symptoms such as resting tremor, bradykinesia, rigidity and freezing of gait. The most common symptom in speech is called hypokinetic dysarthria, where speech is characterized by monotone intensity, low pitch variability and poor prosody that tends to fade at the end of the utterance. This study proposes the classification of patients with Parkinson's Disease and healthy controls in three different languages (Spanish, German, and Czech) using a transfer learning strategy. The process is further improved by freezing consecutive different layers of the architecture. We hypothesize that some convolutional layers characterize the disease and others the language. Therefore, when a fine-tuning in the transfer learning is performed, it is possible to find the topology that best adapts to the target language and allows an accurate detection of Parkinson's Disease. The proposed methodology uses Convolutional Neural Networks trained with Mel-scale spectrograms. Results indicate that the fine-tuning of the neural network does not provide good performance in all languages while fine-tuning of individual layers improves the accuracy by up to 7%. In addition, the results show that Transfer Learning among languages improves the performance in up to 18% when compared to a base model used to initialize the weights of the network.
引用
收藏
页码:331 / 339
页数:9
相关论文
共 50 条
  • [31] Prediction of Freezing of Gait in Parkinson's Disease from Foot Plantar-Pressure Arrays using a Convolutional Neural Network
    Shalin, Gaurav
    Pardoel, Scott
    Nantel, Julie
    Lemaire, Edward D.
    Kofman, Jonathan
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 244 - 247
  • [32] Diagnosis of Parkinson's Disease from Continuous Speech using Deep Convolutional Networks without Manual Selection of Features
    Frid, Alex
    Kantor, Ariel
    Svechin, Dimitri
    Maneyitz, Latrv M.
    2016 IEEE INTERNATIONAL CONFERENCE ON THE SCIENCE OF ELECTRICAL ENGINEERING (ICSEE), 2016,
  • [33] Convolutional Neural Networks for Neuroimaging in Parkinson's Disease: Is Preprocessing Needed?
    Martinez-Murcia, Francisco J.
    Gorriz, Juan M.
    Ramirez, Javier
    Ortiz, Andres
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2018, 28 (10)
  • [34] On the Layer Choice of the Image Style Transfer Using Convolutional Neural Networks
    Lee, Pei-Ying
    Tseng, Chien-Cheng
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [35] Enhancing Speech Recognition for Parkinson’s Disease Patient Using Transfer Learning Technique
    Yu, Qing
    Ma, Yi
    Li, Yongfu
    Journal of Shanghai Jiaotong University (Science), 2022, 27 (01): : 90 - 98
  • [36] Enhancing Speech Recognition for Parkinson’s Disease Patient Using Transfer Learning Technique
    Yu Q.
    Ma Y.
    Li Y.
    Journal of Shanghai Jiaotong University (Science), 2022, 27 (1): : 90 - 98
  • [37] Parkinson's Disease Detection Using Isosurfaces-Based Features and Convolutional Neural Networks
    Ortiz, Andres
    Munilla, Jorge
    Martinez-Ibanez, Manuel
    Gorriz, Juan M.
    Ramirez, Javier
    Salas-Gonzalez, Diego
    FRONTIERS IN NEUROINFORMATICS, 2019, 13
  • [38] Parkinson’s disease diagnosis using convolutional neural networks and figure-copying tasks
    Mohamad Alissa
    Michael A. Lones
    Jeremy Cosgrove
    Jane E. Alty
    Stuart Jamieson
    Stephen L. Smith
    Marta Vallejo
    Neural Computing and Applications, 2022, 34 : 1433 - 1453
  • [39] Parkinson's disease diagnosis using convolutional neural networks and figure-copying tasks
    Alissa, Mohamad
    Lones, Michael A.
    Cosgrove, Jeremy
    Alty, Jane E.
    Jamieson, Stuart
    Smith, Stephen L.
    Vallejo, Marta
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (02): : 1433 - 1453
  • [40] Image style transfer using convolutional neural networks based on transfer learning
    Gupta, Varun
    Sadana, Rajat
    Moudgil, Swastikaa
    International Journal of Computational Systems Engineering, 2019, 5 (01) : 53 - 60