3D dense convolutional neural network for fast and accurate single MR image super-resolution

被引:8
|
作者
Wang, Lulu [1 ]
Du, Jinglong [1 ]
Gholipour, Ali [2 ]
Zhu, Huazheng [3 ]
He, Zhongshi [1 ]
Jia, Yuanyuan [4 ,5 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Harvard Med Sch, Boston Childrens Hosp, Dept Radiol, Boston, MA 02115 USA
[3] Chongqing Univ Sci & Technol, Coll Intelligent Technol & Engn, Chongqing 401331, Peoples R China
[4] Chongqing Med Univ, Coll Med Informat, Chongqing 400016, Peoples R China
[5] Chongqing Med Univ, Med Data Sci Acad, Chongqing 400016, Peoples R China
基金
美国国家卫生研究院; 中国国家自然科学基金;
关键词
Magnetic resonance imaging; Super-resolution reconstruction; 3D dense network; Multi-scale reconstruction; RESOLUTION; RECONSTRUCTION;
D O I
10.1016/j.compmedimag.2021.101973
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Super-resolution (SR) MR image reconstruction has shown to be a very promising direction to improve the spatial resolution of low-resolution (LR) MR images. In this paper, we presented a novel MR image SR method based on a dense convolutional neural network (DDSR), and its enhanced version called EDDSR. There are three major innovations: first, we re-designed dense modules to extract hierarchical features directly from LR images and propagate the extracted feature maps through dense connections. Therefore, unlike other CNN-based SR MR techniques that upsample LR patches in the initial phase, our methods take the original LR images or patches as input. This effectively reduces computational complexity and speeds up SR reconstruction. Second, a final deconvolution filter in our model automatically learns filters to fuse and upscale all hierarchical feature maps to generate HR MR images. Using this, EDDSR can perform SR reconstructions at different upscale factors using a single model with one stride fixed deconvolution operation. Third, to further improve SR reconstruction accuracy, we exploited a geometric self-ensemble strategy. Experimental results on three benchmark datasets demonstrate that our methods, DDSR and EDDSR, achieved superior performance compared to state-of-the-art MR image SR methods with less computational load and memory usage.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Fusion diversion network for fast, accurate and lightweight single image super-resolution
    Zheng Gu
    Liping Chen
    Yanhong Zheng
    Tong Wang
    Tieying Li
    [J]. Signal, Image and Video Processing, 2021, 15 : 1351 - 1359
  • [22] Fast and Accurate Single Image Super-Resolution via Information Distillation Network
    Hui, Zheng
    Wang, Xiumei
    Gao, Xinbo
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 723 - 731
  • [23] Single Image Super-Resolution Based on Global Dense Feature Fusion Convolutional Network
    Xu, Wang
    Chen, Renwen
    Huang, Bin
    Zhang, Xiang
    Liu, Chuan
    [J]. SENSORS, 2019, 19 (02)
  • [24] Channel Split Convolutional Neural Network for Single Image Super-Resolution (CSISR)
    Prajapati, Kalpesh
    Chudasama, Vishal
    Upla, Kishor
    Raia, Kiran
    Ramachandra, Raghavendra
    Busch, Christoph
    [J]. 2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [25] Mixed 2D/3D Convolutional Network for Hyperspectral Image Super-Resolution
    Li, Qiang
    Wang, Qi
    Li, Xuelong
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [26] 3D Microbubble Localization with a Convolutional Neural Network for Super-Resolution Ultrasound Imaging
    Piepenbrock, Marion
    Koretskaia, Dania
    Schmitz, Georg
    Dencks, Stefanie
    [J]. INTERNATIONAL ULTRASONICS SYMPOSIUM (IEEE IUS 2021), 2021,
  • [27] HYPERSPECTRAL IMAGE SUPER-RESOLUTION BASED ON MULTI-SCALE WAVELET 3D CONVOLUTIONAL NEURAL NETWORK
    Yang, Jingxiang
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2770 - 2773
  • [28] Video Super-resolution by Generative Adversarial Network with 3D Convolutional Neural Networks
    Moriyama, Kohei
    Ono, Naoki
    Inoue, Kohei
    Hara, Kenji
    [J]. INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
  • [29] Brain MR Image Super-resolution using 3D Feature Attention Network
    Wang, Lulu
    Du, Jinglong
    Zhu, Huazheng
    He, Zhongshi
    Jia, Yuanyuan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 1151 - 1155
  • [30] Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution
    Jia, Sen
    Zhu, Shuangzhao
    Wang, Zhihao
    Xu, Meng
    Wang, Weixi
    Guo, Yujuan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61