Transfer Learning to Detect Parkinson's Disease from Speech In Different Languages Using Convolutional Neural Networks with Layer Freezing

被引:8
|
作者
David Rios-Urrego, Cristian [1 ]
Camilo Vasquez-Correa, Juan [1 ,2 ]
Rafael Orozco-Arroyave, Juan [1 ,2 ]
Noeth, Elmar [2 ]
机构
[1] Univ Antioquia UdeA, Fac Engn, Medellin, Colombia
[2] Friedrich Alexander Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
来源
基金
欧盟地平线“2020”;
关键词
Parkinson's disease; Speech processing; Transfer Learning; Convolutional neural networks;
D O I
10.1007/978-3-030-58323-1_36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's Disease is a neurodegenerative disorder characterized by motor symptoms such as resting tremor, bradykinesia, rigidity and freezing of gait. The most common symptom in speech is called hypokinetic dysarthria, where speech is characterized by monotone intensity, low pitch variability and poor prosody that tends to fade at the end of the utterance. This study proposes the classification of patients with Parkinson's Disease and healthy controls in three different languages (Spanish, German, and Czech) using a transfer learning strategy. The process is further improved by freezing consecutive different layers of the architecture. We hypothesize that some convolutional layers characterize the disease and others the language. Therefore, when a fine-tuning in the transfer learning is performed, it is possible to find the topology that best adapts to the target language and allows an accurate detection of Parkinson's Disease. The proposed methodology uses Convolutional Neural Networks trained with Mel-scale spectrograms. Results indicate that the fine-tuning of the neural network does not provide good performance in all languages while fine-tuning of individual layers improves the accuracy by up to 7%. In addition, the results show that Transfer Learning among languages improves the performance in up to 18% when compared to a base model used to initialize the weights of the network.
引用
收藏
页码:331 / 339
页数:9
相关论文
共 50 条
  • [21] Classification of Diabetic Retinopathy Disease with Transfer Learning using Deep Convolutional Neural Networks
    Somasundaram, Krishnamoorthy
    Sivakumar, Paulraj
    Suresh, Durairaj
    ADVANCES IN ELECTRICAL AND COMPUTER ENGINEERING, 2021, 21 (03) : 49 - 56
  • [22] Proposing a new approach based on convolutional neural networks and random forest for the diagnosis of Parkinson's disease from speech signals
    Celik, Gaffari
    Basaran, Erdal
    APPLIED ACOUSTICS, 2023, 211
  • [23] Recognition of Emotions in Speech Using Convolutional Neural Networks on Different Datasets
    Zielonka, Marta
    Piastowski, Artur
    Czyzewski, Andrzej
    Nadachowski, Pawel
    Operlejn, Maksymilian
    Kaczor, Kamil
    ELECTRONICS, 2022, 11 (22)
  • [24] Differentiation of speech in Parkinson’s disease and spinocerebellar degeneration using deep neural networks
    Katsuki Eguchi
    Hiroaki Yaguchi
    Ikue Kudo
    Ibuki Kimura
    Tomoko Nabekura
    Ryuto Kumagai
    Kenichi Fujita
    Yuichi Nakashiro
    Yuki Iida
    Shinsuke Hamada
    Sanae Honma
    Asako Takei
    Fumio Moriwaka
    Ichiro Yabe
    Journal of Neurology, 2024, 271 : 1004 - 1012
  • [25] Prediction of Parkinson’s disease based on artificial neural networks using speech datasets
    Liu W.
    Liu J.
    Peng T.
    Wang G.
    Balas V.E.
    Geman O.
    Chiu H.-W.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (10) : 13571 - 13584
  • [26] Differentiation of speech in Parkinson's disease and spinocerebellar degeneration using deep neural networks
    Eguchi, Katsuki
    Yaguchi, Hiroaki
    Kudo, Ikue
    Kimura, Ibuki
    Nabekura, Tomoko
    Kumagai, Ryuto
    Fujita, Kenichi
    Nakashiro, Yuichi
    Iida, Yuki
    Hamada, Shinsuke
    Honma, Sanae
    Takei, Asako
    Moriwaka, Fumio
    Yabe, Ichiro
    JOURNAL OF NEUROLOGY, 2024, 271 (02) : 1004 - 1012
  • [27] USING X-VECTORS TO AUTOMATICALLY DETECT PARKINSON'S DISEASE FROM SPEECH
    Moro-Velazquez, Laureano
    Villalba, Jesus
    Dehak, Najim
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1155 - 1159
  • [28] Transfer Learning to Detect COVID-19 Automatically from X-Ray Images Using Convolutional Neural Networks
    Taresh, Mundher Mohammed
    Zhu, Ningbo
    Ali, Talal Ahmed Ali
    Hameed, Asaad Shakir
    Mutar, Modhi Lafta
    INTERNATIONAL JOURNAL OF BIOMEDICAL IMAGING, 2021, 2021
  • [29] Convolutional Neural Networks for Texture Recognition Using Transfer Learning
    Chen-McCaig, Zack
    Hoseinnezhad, Reza
    Bab-Hadiashar, Alireza
    2017 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND INFORMATION SCIENCES (ICCAIS), 2017, : 187 - 192
  • [30] Diagnosing Parkinson's disease with speech signal based on convolutional neural network
    Zhang, Tao
    Zhang, Yajuan
    Cao, Yuyang
    Li, Lin
    Hao, Lianwang
    INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2020, 63 (04) : 348 - 353