Classification of Alzheimer's disease: application of a transfer learning deep Q-network method

被引:0
|
作者
Ma, Huibin [1 ,2 ]
Wang, Yadan [1 ,2 ]
Hao, Zeqi [3 ]
Yu, Yang [4 ]
Jia, Xize [5 ]
Li, Mengting [3 ]
Chen, Lanfen [6 ]
机构
[1] Jiamusi Univ, Sch Informat & Elect Technol, Jiamusi, Peoples R China
[2] Key Lab Autonomous Intelligence & Informat Proc He, Jiamusi, Peoples R China
[3] Zhejiang Normal Univ, Sch Psychol, Jinhua, Peoples R China
[4] Zhejiang Univ, Affiliated Hosp 2, Sch Med, Dept Psychiat, Hangzhou, Zhejiang, Peoples R China
[5] Xuzhou Med Univ, Changshu Peoples Hosp 2, Affiliated Changshu Hosp, Dept Radiol, Changshu, Peoples R China
[6] Weifang Med Univ, Sch Med Imaging, Weifang, Peoples R China
基金
中国国家自然科学基金;
关键词
Alzheimer's disease; deep Q-network; local metrics; reinforcement learning; resting-state fMRI; transfer learning; MILD COGNITIVE IMPAIRMENT; RESTING-STATE FMRI; AMPLITUDE;
D O I
10.1111/ejn.16261
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Early diagnosis is crucial to slowing the progression of Alzheimer's disease (AD), so it is urgent to find an effective diagnostic method for AD. This study intended to investigate whether the transfer learning approach of deep Q-network (DQN) could effectively distinguish AD patients using local metrics of resting-state functional magnetic resonance imaging (rs-fMRI) as features. This study included 1310 subjects from the Consortium for Reliability and Reproducibility (CoRR) and 50 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) GO/2. The amplitude of low-frequency fluctuation (ALFF), fractional ALFF (fALFF) and percent amplitude of fluctuation (PerAF) were extracted as features using the Power 264 atlas. Based on gender bias in AD, we searched for transferable similar parts between the CoRR feature matrix and the ADNI feature matrix, resulting in the CoRR similar feature matrix served as the source domain and the ADNI similar feature matrix served as the target domain. A DQN classifier was pre-trained in the source domain and transferred to the target domain. Finally, the transferred DQN classifier was used to classify AD and healthy controls (HC). A permutation test was performed. The DQN transfer learning achieved a classification accuracy of 86.66% (p < 0.01), recall of 83.33% and precision of 83.33%. The findings suggested that the transfer learning approach using DQN could be an effective way to distinguish AD from HC. It also revealed the potential value of local brain activity in AD clinical diagnosis.
引用
收藏
页码:2118 / 2127
页数:10
相关论文
共 50 条
  • [1] Deep Deformable Q-Network: An Extension of Deep Q-Network
    Jin, Beibei
    Yang, Jianing
    Huang, Xiangsheng
    Khan, Dawar
    2017 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE (WI 2017), 2017, : 963 - 966
  • [2] Application of Deep Learning in Classification and Diagnosis of Alzheimer’s Disease
    Du, Yuzheng
    Cao, Hui
    Nie, Yongqi
    Wei, Dejian
    Feng, Yanyan
    Computer Engineering and Applications, 2024, 59 (03) : 49 - 65
  • [3] Application of Deep Q-Network in Portfolio Management
    Gao, Ziming
    Gao, Yuan
    Hu, Yi
    Jiang, Zhengyong
    Su, Jionglong
    2020 5TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (IEEE ICBDA 2020), 2020, : 268 - 275
  • [4] Twice Sampling Method in Deep Q-network
    Zhao Y.-N.
    Liu P.
    Zhao W.
    Tang X.-L.
    Zidonghua Xuebao/Acta Automatica Sinica, 2019, 45 (10): : 1870 - 1882
  • [5] Noisy Deep Dictionary Learning: Application to Alzheimer's Disease Classification
    Singhal, Vanika
    Majumdar, Angshul
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 2679 - 2683
  • [6] Influence on Learning of Various Conditions in Deep Q-Network
    Niitsuma, Jun
    Osana, Yuko
    2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2017, : 1932 - 1935
  • [7] Alzheimer's Disease Stage Classification Using a Deep Transfer Learning and Sparse Auto Encoder Method
    Oommen, Deepthi K.
    Arunnehru, J.
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (01): : 793 - 811
  • [8] Multiagent Learning and Coordination with Clustered Deep Q-Network
    Pageaud, Simon
    Deslandres, Veronique
    Lehoux, Vassilissa
    Hassas, Salima
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 2156 - 2158
  • [9] Deep Reinforcement Learning. Case Study: Deep Q-Network
    Vrejoiu, Mihnea Horia
    ROMANIAN JOURNAL OF INFORMATION TECHNOLOGY AND AUTOMATIC CONTROL-REVISTA ROMANA DE INFORMATICA SI AUTOMATICA, 2019, 29 (03): : 65 - 78
  • [10] Deep Reinforcement Learning Pairs Trading with a Double Deep Q-Network
    Brim, Andrew
    2020 10TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2020, : 222 - 227