Bidirectional Mapping Perception-enhanced Cycle-consistent Generative Adversarial Network for Super-resolution of Brain MRI images

被引:0
|
作者
Sun, Jie [1 ]
Jiang, Juanjuan [1 ]
Ling, Ronghua [1 ]
Wang, Luyao [1 ]
Jiang, Jiehui [1 ]
Wang, Min [1 ]
机构
[1] Shanghai Univ, Inst Biomed Engn, Sch Life Sci, Shanghai, Peoples R China
基金
中国博士后科学基金; 上海市科技启明星计划; 中国国家自然科学基金;
关键词
D O I
10.1109/EMBC40787.2023.10340042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an effective tool for visualizing neurodegeneration, high-resolution structural magnetism facilitates quantitative image analysis and clinical applications. Super-resolution reconstruction technology allows to improve the resolution of images without upgrading the scanning hardware. However, existing super-resolution techniques relied on paired image data sets and lacked further quantitative analysis of the generated images. In this study, we proposed a semi-supervised generative adversarial network (GAN) model for super-resolution of brain MRI, and the synthetic images were evaluated using various quantitative measures. This model adopted the cycle-consistency structure to allow for a mixture of unpaired data for training. Perceptual loss was further introduced into the model to preserve detailed texture features at high frequencies. 363 subjects with both high-resolution (HR) and low-resolution (LR) scans and 217 subjects with HR scans only were used for model derivation, training, and validation. We extracted multiple voxel-based and surface-based morphological features of the synthetic and real 3D HR images for comparison. We further evaluated the synthetic images in the differential diagnosis of diseases. Our model achieved superior mean absolute error (0.049 +/- 0.021), mean squared error (0.0059 +/- 0.0043), peak signal-to-noise ratio (29.41 +/- 3.71), structural similarity index measure (0.914 +/- 0.048). Eight morphological metrics, both voxel-based and surface-based, showed significant agreement (P<0.0001). The gap of accuracy in disease diagnosis between synthetic and real HR images was within 5% and significantly outperformed the LR images. Our proposed model enables the reconstruction of HR MRI and could be used accurately for image quantification.
引用
收藏
页数:4
相关论文
共 50 条
  • [41] The Use of a Stable Super-Resolution Generative Adversarial Network (SSRGAN) on Remote Sensing Images
    Pang, Boyu
    Zhao, Siwei
    Liu, Yinnian
    REMOTE SENSING, 2023, 15 (20)
  • [42] Super-Resolution of Remote Sensing Images via a Dense Residual Generative Adversarial Network
    Ma, Wen
    Pan, Zongxu
    Yuan, Feng
    Lei, Bin
    REMOTE SENSING, 2019, 11 (21)
  • [43] SELF-NORMALIZING GENERATIVE ADVERSARIAL NETWORK FOR SUPER-RESOLUTION RECONSTRUCTION OF SAR IMAGES
    Zheng, Ce
    Jiang, Xue
    Zhang, Ye
    Liu, Xingzhao
    Yuan, Bin
    Li, Zhixin
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 1911 - 1914
  • [44] TEXT-ATTENTIONAL CONDITIONAL GENERATIVE ADVERSARIAL NETWORK FOR SUPER-RESOLUTION OF TEXT IMAGES
    Wang, Yuyang
    Su, Feng
    Qian, Ye
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1024 - 1029
  • [45] Fast and accurate super-resolution of MR images based on lightweight generative adversarial network
    Hangyu Li
    Zuxing Xuan
    Jianpin Zhou
    Xiyuan Hu
    Bo Yang
    Multimedia Tools and Applications, 2023, 82 : 2465 - 2487
  • [46] Self-Supervised Pansharpening Based on a Cycle-Consistent Generative Adversarial Network
    Li, Jie
    Sun, Weixuan
    Jiang, Menghui
    Yuan, Qiangqiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [47] Spatial Attention Gated Variational Autoencoder Enhanced Cycle-Consistent Generative Adversarial Networks for MRI to CT Translation
    Kearney, V.
    Zeimer, B. P.
    Perry, A.
    Wang, T.
    Chan, J.
    Yom, S. S.
    Solberg, T. D.
    INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2019, 105 (01): : E720 - E721
  • [48] Single Image Super-Resolution: Depthwise Separable Convolution Super-Resolution Generative Adversarial Network
    Jiang, Zetao
    Huang, Yongsong
    Hu, Lirui
    APPLIED SCIENCES-BASEL, 2020, 10 (01):
  • [49] Image Super-Resolution Reconstruction Algorithm Based on Improved Enhanced Generative Adversarial Network
    She, Xiangyang
    Yang, Qinghao
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CRYPTOGRAPHY, NETWORK SECURITY AND COMMUNICATION TECHNOLOGY, CNSCT 2024, 2024, : 644 - 651
  • [50] Number plate recognition from enhanced super-resolution using generative adversarial network
    Kabiraj, Anwesh
    Pal, Debojyoti
    Ganguly, Debayan
    Chatterjee, Kingshuk
    Roy, Sudipta
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (09) : 13837 - 13853