Gradual back-projection residual attention network for magnetic resonance image super-resolution

被引:23
|
作者
Qiu, Defu [1 ,2 ]
Cheng, Yuhu [1 ,2 ]
Wang, Xuesong [1 ,2 ]
机构
[1] China Univ Min & Technol, Engn Res Ctr Intelligent Control Underground Spac, Minist Educ, Xuzhou 221116, Jiangsu, Peoples R China
[2] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Magnetic resonance image; Super-resolution; Gradual back-projection network; Residual attention; mechanism; Convolutional neural network;
D O I
10.1016/j.cmpb.2021.106252
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and objective: Magnetic Resonance Image (MRI) analysis can provide anatomical examination of internal organs, which is helpful for diagnosis of the disease. Aiming at the problems of insufficient feature information mining in the process of MRI super-resolution (SR) reconstruction, the difficulty of determining the interdependence between the channels of the feature map, and the reconstruction error when reconstructing high-resolution (HR) images, we propose a SR method to solve these problems. Methods: In this work, we propose a gradual back-projection residual attention network for MRI super resolution (GRAN), which outperforms most of the state-of-the-art methods. Firstly, we use the gradual upsampling method to gradually scale the low-resolution (LR) image to a given magnification to alleviate the high-frequency information loss caused by the upsampling process. Secondly, we merge the idea of iterative back-projection at each stage of gradual upsampling, learn the mapping relationship between HR and LR feature maps and reduce the noise introduced during the upsampling process. Finally, we use the attention mechanism to dynamically allocate attention resources to the feature maps generated at different stages of the gradual back-projection network, so that the network model can learn the interdependence between each feature map. Results: For the 2 x and 4 x enlargement, the proposed GRAN method shows the superiority over the state-of-the-art methods on the Set5, Set14, and Urban100 benchmark datasets, extensive benchmark experiment and analysis show that the superiority of the GRAN algorithm in terms of peak signal-to-noise ratio and structural similarity index indicators. Conclusion: The MRI results reconstructed by gradual back-projection residual attention network on the public dataset IDI have good image sharpness, rich texture details and good visual experience. In addition, the reconstructed image is the closest to the real image, enabling the medical expert to see the biological tissue structure and its early pathological changes more clearly, providing assistance and support to the medical expert in the diagnosis and treatment of the disease. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Super-Resolution Reconstruction of License Plate Image Based on Gradual Back-Projection Network
    Wang Dianwei
    Hao Yuanjie
    Liu Ying
    Xie Yongjun
    Song Haijun
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (16)
  • [2] Weather Radar Super-Resolution Reconstruction Based on Residual Attention Back-Projection Network
    Yu, Qiu
    Zhu, Ming
    Zeng, Qiangyu
    Wang, Hao
    Chen, Qingqing
    Fu, Xiangyu
    Qing, Zhipeng
    [J]. REMOTE SENSING, 2023, 15 (08)
  • [3] Multiscale Feature Fusion Back-projection Network for Image Super-resolution
    Sun, Chao-Wen
    Chen, Xiao
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (07): : 1689 - 1700
  • [4] SUPER-RESOLUTION BASED ON BACK-PROJECTION OF INTERPOLATED IMAGE
    Kiatpapan, Sawiya
    Yamaguchi, Takuro
    Ikehara, Masaaki
    [J]. 2019 12TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR COMMUNICATIONS (ATC 2019), 2019, : 302 - 307
  • [5] Arbitrary Back-Projection Networks for Image Super-Resolution
    Ma, Tingsong
    Tian, Wenhong
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2020, 19 (04)
  • [6] RBPNET: An asymptotic Residual Back-Projection Network for super-resolution of very low-resolution face image
    Chen, Xiaozhen
    Wang, Xuebo
    Lu, Yao
    Li, Weiqi
    Wang, Zijian
    Huang, Zhuowei
    [J]. NEUROCOMPUTING, 2020, 376 : 119 - 127
  • [7] Recurrent Back-Projection Network for Video Super-Resolution
    Haris, Muhammad
    Shakhnarovich, Greg
    Ukita, Norimichi
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3892 - 3901
  • [8] Deep iterative residual back-projection networks for single-image super-resolution
    Tian, Chuan
    Hu, Jing
    Wu, Xi
    Wen, Wu
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (02)
  • [9] Novel Back-projection Framework for Single Image Super-Resolution
    Zhao, Bin
    Gan, Zongliang
    Zhang, Yanbin
    Liu, Feng
    Wang, Huanjuan
    [J]. PROCEEDINGS OF 2012 IEEE 11TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP) VOLS 1-3, 2012, : 894 - 898
  • [10] Efficient Single Image Super-Resolution via Hybrid Residual Feature Learning with Compact Back-Projection Network
    Zhu, Feiyang
    Zhao, Qijun
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2453 - 2460