Transfer Learning to Detect Parkinson's Disease from Speech In Different Languages Using Convolutional Neural Networks with Layer Freezing

被引:8
|
作者
David Rios-Urrego, Cristian [1 ]
Camilo Vasquez-Correa, Juan [1 ,2 ]
Rafael Orozco-Arroyave, Juan [1 ,2 ]
Noeth, Elmar [2 ]
机构
[1] Univ Antioquia UdeA, Fac Engn, Medellin, Colombia
[2] Friedrich Alexander Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
来源
基金
欧盟地平线“2020”;
关键词
Parkinson's disease; Speech processing; Transfer Learning; Convolutional neural networks;
D O I
10.1007/978-3-030-58323-1_36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's Disease is a neurodegenerative disorder characterized by motor symptoms such as resting tremor, bradykinesia, rigidity and freezing of gait. The most common symptom in speech is called hypokinetic dysarthria, where speech is characterized by monotone intensity, low pitch variability and poor prosody that tends to fade at the end of the utterance. This study proposes the classification of patients with Parkinson's Disease and healthy controls in three different languages (Spanish, German, and Czech) using a transfer learning strategy. The process is further improved by freezing consecutive different layers of the architecture. We hypothesize that some convolutional layers characterize the disease and others the language. Therefore, when a fine-tuning in the transfer learning is performed, it is possible to find the topology that best adapts to the target language and allows an accurate detection of Parkinson's Disease. The proposed methodology uses Convolutional Neural Networks trained with Mel-scale spectrograms. Results indicate that the fine-tuning of the neural network does not provide good performance in all languages while fine-tuning of individual layers improves the accuracy by up to 7%. In addition, the results show that Transfer Learning among languages improves the performance in up to 18% when compared to a base model used to initialize the weights of the network.
引用
收藏
页码:331 / 339
页数:9
相关论文
共 50 条
  • [1] Convolutional Neural Networks and a Transfer Learning Strategy to Classify Parkinson's Disease from Speech in Three Different Languages
    Vasquez-Correa, Juan Camilo
    Arias-Vergara, Tomas
    Rios-Urrego, Cristian D.
    Schuster, Maria
    Rusz, Jan
    Orozco-Arroyave, Juan Rafael
    Noeth, Elmar
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS (CIARP 2019), 2019, 11896 : 697 - 706
  • [2] Convolutional neural networks to detect Parkinson's disease based on voice recordings and transfer learning
    Merino Delgado, Daniel Francisco
    Rufo Bazaga, Maria Jesus
    Mateos Caballero, Alfonso
    Perez Sanchez, Carlos Javier
    IEEE CONFERENCE ON EVOLVING AND ADAPTIVE INTELLIGENT SYSTEMS 2024, IEEE EAIS 2024, 2024, : 148 - 152
  • [3] Dysarthric-speech detection using transfer learning with convolutional neural networks
    Sekhar, S. R. Mani
    Kashyap, Gaurav
    Bhansali, Akshay
    Abishek, Andrew A.
    Singh, Kushan
    ICT EXPRESS, 2022, 8 (01): : 61 - 64
  • [4] Federated learning for secure development of AI models for Parkinson's disease detection using speech from different languages
    Arasteh, Soroosh Tayebi
    Rios-Urrego, Cristian David
    Noeth, Elmar
    Maier, Andreas
    Yang, Seung Hee
    Rusz, Jan
    Orozco-Arroyave, Juan Rafael
    INTERSPEECH 2023, 2023, : 5003 - 5007
  • [5] Parkinson's Disease Detection from Drawing Movements Using Convolutional Neural Networks
    Gil-Martin, Manuel
    Montero, Juan Manuel
    San-Segundo, Ruben
    ELECTRONICS, 2019, 8 (08)
  • [6] Evaluation of deep convolutional neural networks for detection of freezing of gait in Parkinson's disease patients
    Xia, Yi
    Zhang, Jun
    Ye, Qiang
    Cheng, Nan
    Lu, Yixiang
    Zhang, Dexiang
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2018, 46 : 221 - 230
  • [7] Decoding Speech from Single Trial MEG Signals Using Convolutional Neural Networks and Transfer Learning
    Dash, Debadatta
    Ferrari, Paul
    Heitzman, Daragh
    Wang, Jun
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 5531 - 5535
  • [8] Alzheimer's disease detection using convolutional neural networks and transfer learning based methods
    Zaabi, Marwa
    Smaoui, Nadia
    Derbel, Houda
    Hariri, Walid
    PROCEEDINGS OF THE 2020 17TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS & DEVICES (SSD 2020), 2020, : 939 - 943
  • [9] Enhancing Parkinson's Disease Prediction Using Deep Learning-Based Convolutional Neural Networks
    Ramya, R.
    Ramesh, C.
    Murugesan, P.
    Nithya, N.
    Kumar, G. Sathish
    JOURNAL OF ELECTRICAL SYSTEMS, 2024, 20 (05) : 1866 - 1874
  • [10] Layer Removal for Transfer Learning with Deep Convolutional Neural Networks
    Zhi, Weiming
    Chen, Zhenghao
    Yueng, Henry Wing Fung
    Lu, Zhicheng
    Zandavi, Seid Miad
    Chung, Yuk Ying
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 460 - 469