A hybrid convolutional neural network for super-resolution reconstruction of MR images

被引:18
|
作者
Zheng, Yingjie [1 ,2 ]
Zhen, Bowen [1 ,2 ]
Chen, Aichi [3 ]
Qi, Fulang [1 ,2 ]
Hao, Xiaohan [1 ,2 ]
Qiu, Bensheng [1 ,2 ]
机构
[1] Univ Sci & Technol China, Hefei Natl Lab Phys Sci Microscale, Hefei 230026, Anhui, Peoples R China
[2] Univ Sci & Technol China, Ctr Biomed Engn, Hefei 230026, Anhui, Peoples R China
[3] Univ Calif Los Angeles, Dept Radiol, Los Angeles, CA 90095 USA
关键词
convolutional neural network; hybrid network; MR images; super-resolution;
D O I
10.1002/mp.14152
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose Spatial resolution is an important parameter for magnetic resonance imaging (MRI). High-resolution MR images provide detailed information and benefit subsequent image analysis. However, higher resolution MR images come at the expense of longer scanning time and lower signal-to-noise ratios (SNRs). Using algorithms to improve image resolution can mitigate these limitations. Recently, some convolutional neural network (CNN)-based super-resolution (SR) algorithms have flourished on MR image reconstruction. However, most algorithms usually adopt deeper network structures to improve the performance. Methods In this study, we propose a novel hybrid network (named HybridNet) to improve the quality of SR images by increasing the width of the network. Specifically, the proposed hybrid block combines a multipath structure and variant dense blocks to extract abundant features from low-resolution images. Furthermore, we fully exploit the hierarchical features from different hybrid blocks to reconstruct high-quality images. Results All SR algorithms are evaluated using three MR image datasets and the proposed HybridNet outperformed the comparative methods with peak a signal-to-noise ratio (PSNR) of 42.12 +/- 0.92 dB, 38.60 +/- 2.46 dB, 35.17 +/- 2.96 dB and a structural similarity index (SSIM) of 0.9949 +/- 0.0015, 0.9892 +/- 0.0034, 0.9740 +/- 0.0064, respectively. Besides, our proposed network can reconstruct high-quality images on an unseen MR dataset with PSNR of 33.27 +/- 1.56 and SSIM of 0.9581 +/- 0.0068. Conclusions The results demonstrate that HybridNet can reconstruct high-quality SR images from degraded MR images and has good generalization ability. It also can be leveraged to assist the task of image analysis or processing.
引用
收藏
页码:3013 / 3022
页数:10
相关论文
共 50 条
  • [41] HYPERSPECTRAL SUPER-RESOLUTION BY UNSUPERVISED CONVOLUTIONAL NEURAL NETWORK AND SURE
    Nguyen, Han V.
    Ulfarsson, Magnus O.
    Sveinsson, Johannes R.
    Mura, Mauro Dalla
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 903 - 906
  • [42] A Deep Convolutional Neural Network with Selection Units for Super-Resolution
    Choi, Jae-Seok
    Kim, Munchurl
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1150 - 1156
  • [43] Image super-resolution using a dilated convolutional neural network
    Lin, Guimin
    Wu, Qingxiang
    Qiu, Lida
    Huang, Xixian
    NEUROCOMPUTING, 2018, 275 : 1219 - 1230
  • [44] ITERATIVE CONVOLUTIONAL NEURAL NETWORK FOR NOISY IMAGE SUPER-RESOLUTION
    Bao, Wenbo
    Zhang, Xiaoyun
    Yan, Shangpeng
    Gao, Zhiyong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 4038 - 4042
  • [45] Image super-resolution with an enhanced group convolutional neural network
    Tian, Chunwei
    Yuan, Yixuan
    Zhang, Shichao
    Lin, Chia-Wen
    Zuo, Wangmeng
    Zhang, David
    NEURAL NETWORKS, 2022, 153 : 373 - 385
  • [46] Image Super-Resolution Using Residual Convolutional Neural Network
    Lee, Pei-Ying
    Tseng, Chien-Cheng
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [47] Single Image Super-Resolution Based on Convolutional Neural Network
    Shi Ziteng
    Wang Zhiren
    Wang Rui
    Ren Fuquan
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (12)
  • [48] Deep Depth Super-Resolution: Learning Depth Super-Resolution Using Deep Convolutional Neural Network
    Song, Xibin
    Dai, Yuchao
    Qin, Xueying
    COMPUTER VISION - ACCV 2016, PT IV, 2017, 10114 : 360 - 376
  • [49] A Super-Resolution Convolutional-Neural-Network-Based Approach for Subpixel Mapping of Hyperspectral Images
    Ma, Xiaofeng
    Hong, Youtang
    Song, Yongze
    Chen, Yujia
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (12) : 4930 - 4939
  • [50] Accuracy improvement of quantification information using super-resolution with convolutional neural network for microscopy images
    Kang, Mi-Sun
    Cha, Eunju
    Kang, Eunhee
    Ye, Jong Chul
    Her, Nam-Gu
    Oh, Jeong-Woo
    Nam, Do-Hyun
    Kim, Myoung-Hee
    Yang, Sejung
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 58 (58)