Multimodal Retinal Imaging Classification for Parkinson's Disease Using a Convolutional Neural Network

被引:0
|
作者
Richardson, Alexander [1 ,2 ,3 ]
Kundu, Anita [1 ,2 ]
Henao, Ricardo [2 ,3 ]
Lee, Terry [1 ,2 ]
Scott, Burton L. [2 ,4 ]
Grewal, Dilraj S. [1 ,2 ]
Fekrat, Sharon [1 ,2 ,4 ]
机构
[1] Duke Univ, Sch Med, Duke Eye Ctr, Dept Ophthalmol, Box 3802,Erwin Rd, Durham, NC 27710 USA
[2] Duke Univ, Sch Med, iMIND Res Grp, Durham, NC USA
[3] Duke Univ, Dept Comp Sci, Durham, NC USA
[4] Duke Univ, Sch Med, Dept Neurol, Durham, NC USA
来源
关键词
machine learning; Parkinson's disease; optical coherence tomography angiography; fundus photography; ganglion cell-inner plexiform layer thickness color maps; DIABETIC-RETINOPATHY; OPTIC-NERVE; SYNUCLEIN;
D O I
10.1167/tvst.13.8.23
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Purpose: Changes in retinal structure and microvasculature are connected to parallel changes in the brain. Two recent studies described machine learning algorithms trained on retinal images and quantitative data that identified Alzheimer's dementia and mild cognitive impairment with high accuracy. Prior studies also demonstrated retinal differences in individuals with PD. Herein, we developed a convolutional neural network (CNN) to classify multimodal retinal imaging from either a Parkinson's disease (PD) or control group. Methods: We trained a CNN to receive retinal image inputs of optical coherence tomogangiography 6 x 6-mm en face macular images of the superficial capillary plexus, and ultra-widefield (UWF) fundus color and autofluorescence photographs to classify the retinal imaging as PD or control. The model consists of a shared pretrained VGG19 feature extractor and image-specific feature transformations which converge to a single output. Model results were assessed using receiver operating characteristic (ROC) curves and bootstrapped 95% confidence intervals for area under the ROC curve (AUC) values. Results: In total, 371 eyes of 249 control subjects and 75 eyes of 52 PD subjects were used for training, validation, and testing. Our best CNN variant achieved an AUC of 0.918. UWF color photographs were the most effective imaging input, and GC-IPL thickness maps were the least contributory. Conclusions: Using retinal images, our pilot CNN was able to identify individuals with PD and serves as a proof of concept to spur the collection of larger imaging datasets needed for clinical-grade algorithms. Translational Relevance: Developing machine learning models for automated detection of Parkinson's disease from retinal imaging could lead to earlier and more widespread diagnoses.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Hispa Rice Disease Classification using Convolutional Neural Network
    Sharma, Rishabh
    Kukreja, Vinay
    Kadyan, Virender
    [J]. ICSPC'21: 2021 3RD INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION (ICPSC), 2021, : 377 - 381
  • [22] Deep Learning Approach to Parkinson's Disease Detection Using Voice Recordings and Convolutional Neural Network Dedicated to Image Classification
    Wodzinski, Marek
    Skalski, Andrzej
    Hemmerling, Dania
    Rafael Orozco-Arroyave, Juan
    Noeth, Elmar
    [J]. 2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 717 - 720
  • [23] Gait classification for Parkinson's Disease using Stacked 2D and 1D Convolutional Neural Network
    Ngoc Son Hoang
    Cai, Yutian
    Lee, Chien-Wei
    Yang, Youheng Ou
    Chui, Chee-Kong
    Chua, Matthew Chin Heng
    [J]. 2019 12TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR COMMUNICATIONS (ATC 2019), 2019, : 44 - 49
  • [24] Classification of Parkinson's disease from smartphone recording data using time-frequency analysis and convolutional neural network
    Worasawate, Denchai
    Asawaponwiput, Warisara
    Yoshimura, Natsue
    Intarapanich, Apichart
    Surangsrirat, Decho
    [J]. TECHNOLOGY AND HEALTH CARE, 2023, 31 (02) : 705 - 718
  • [25] Classification of Alzheimer’s Disease Using Ensemble Convolutional Neural Network With LFA Algorithm
    Kim, Chang-Min
    Lee, Woobeom
    [J]. IEEE ACCESS, 2023, 11 : 143004 - 143015
  • [26] Fovea Localization Neural Network for Multimodal Retinal Imaging
    An, Cheolhong
    Wang, Yiqian
    Zhang, Junkang
    Bartsch, Dirk-Uwe G.
    Freeman, William R.
    [J]. APPLICATIONS OF MACHINE LEARNING 2020, 2020, 11511
  • [27] Detection of Parkinson Disease in Brain MRI using Convolutional Neural Network
    Shah, Pir Masoom
    Zeb, Adnan
    Shafi, Uferah
    Zaidi, Syed Farhan Alam
    Shah, Munam Ali
    [J]. 2018 24TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND COMPUTING (ICAC' 18), 2018, : 495 - 500
  • [28] Multimodal Vehicle Type Classification Using Convolutional Neural Network and Statistical Representations of MFCC
    Selbes, Berkay
    Sert, Mustafa
    [J]. 2017 14TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2017,
  • [29] A convolutional-recurrent neural network approach to resting-state EEG classification in Parkinson's disease
    Lee, Soojin
    Hussein, Ramy
    Ward, Rabab
    Wang, Z. Jane
    McKeown, Martin J.
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2021, 361
  • [30] Automatic multi-disease classification on retinal images using multilevel glowworm swarm convolutional neural network
    Chavan R.
    Pete D.
    [J]. Journal of Engineering and Applied Science, 2024, 71 (01):