3D dense convolutional neural network for fast and accurate single MR image super-resolution

被引:8
|
作者
Wang, Lulu [1 ]
Du, Jinglong [1 ]
Gholipour, Ali [2 ]
Zhu, Huazheng [3 ]
He, Zhongshi [1 ]
Jia, Yuanyuan [4 ,5 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Harvard Med Sch, Boston Childrens Hosp, Dept Radiol, Boston, MA 02115 USA
[3] Chongqing Univ Sci & Technol, Coll Intelligent Technol & Engn, Chongqing 401331, Peoples R China
[4] Chongqing Med Univ, Coll Med Informat, Chongqing 400016, Peoples R China
[5] Chongqing Med Univ, Med Data Sci Acad, Chongqing 400016, Peoples R China
基金
美国国家卫生研究院; 中国国家自然科学基金;
关键词
Magnetic resonance imaging; Super-resolution reconstruction; 3D dense network; Multi-scale reconstruction; RESOLUTION; RECONSTRUCTION;
D O I
10.1016/j.compmedimag.2021.101973
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Super-resolution (SR) MR image reconstruction has shown to be a very promising direction to improve the spatial resolution of low-resolution (LR) MR images. In this paper, we presented a novel MR image SR method based on a dense convolutional neural network (DDSR), and its enhanced version called EDDSR. There are three major innovations: first, we re-designed dense modules to extract hierarchical features directly from LR images and propagate the extracted feature maps through dense connections. Therefore, unlike other CNN-based SR MR techniques that upsample LR patches in the initial phase, our methods take the original LR images or patches as input. This effectively reduces computational complexity and speeds up SR reconstruction. Second, a final deconvolution filter in our model automatically learns filters to fuse and upscale all hierarchical feature maps to generate HR MR images. Using this, EDDSR can perform SR reconstructions at different upscale factors using a single model with one stride fixed deconvolution operation. Third, to further improve SR reconstruction accuracy, we exploited a geometric self-ensemble strategy. Experimental results on three benchmark datasets demonstrate that our methods, DDSR and EDDSR, achieved superior performance compared to state-of-the-art MR image SR methods with less computational load and memory usage.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] SCRSR: An efficient recursive convolutional neural network for fast and accurate image super-resolution
    Lin, Daoyu
    Xu, Guangluan
    Xu, Wenjia
    Wang, Yang
    Sun, Xian
    Fu, Kun
    [J]. NEUROCOMPUTING, 2020, 398 : 399 - 407
  • [2] SINGLE IMAGE SUPER-RESOLUTION USING A NON-LOCAL 3D CONVOLUTIONAL NEURAL NETWORK
    Xiong, Zhuang
    Tao, Xiaoming
    Zhao, Nan
    Lin, Baihong
    [J]. 2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 31 - 35
  • [3] CARN: Convolutional Anchored Regression Network for Fast and Accurate Single Image Super-Resolution
    Li, Yawei
    Agustsson, Eirikur
    Gu, Shuhang
    Timofte, Radu
    Van Gool, Luc
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 166 - 181
  • [4] Super-resolution reconstruction of single anisotropic 3D MR images using residual convolutional neural network
    Du, Jinglong
    He, Zhongshi
    Wang, Lulu
    Gholipour, Ali
    Zhou, Zexun
    Chen, Dingding
    Jia, Yuanyuan
    [J]. NEUROCOMPUTING, 2020, 392 : 209 - 220
  • [5] Lightweight image super-resolution network using 3D convolutional neural networks
    Li, Hailong
    Liu, Zhonghua
    Liu, Yong
    Wu, Di
    Zhang, Kaibing
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)
  • [6] Single Image Super-Resolution Based on Convolutional Neural Network
    Shi Ziteng
    Wang Zhiren
    Wang Rui
    Ren Fuquan
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (12)
  • [7] Accelerated Super-resolution MR Image Reconstruction via a 3D Densely Connected Deep Convolutional Neural Network
    Du, Jinglong
    Wang, Lulu
    Gholipour, Ali
    He, Zhongshi
    Jia, Yuanyuan
    [J]. PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 349 - 355
  • [8] Hyperspectral Image Spatial Super-Resolution via 3D Full Convolutional Neural Network
    Mei, Shaohui
    Yuan, Xin
    Ji, Jingyu
    Zhang, Yifan
    Wan, Shuai
    Du, Qian
    [J]. REMOTE SENSING, 2017, 9 (11)
  • [9] Image Super-Resolution Based on Dense Convolutional Network
    Li, Jie
    Zhou, Yue
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PT II, 2018, 11257 : 134 - 145
  • [10] A NOVEL FAST 3D SINGLE IMAGE SUPER-RESOLUTION ALGORITHM
    Tuador, Nwigbo Kenule
    Duong Hung Pham
    Michetti, Jerome
    Basarab, Adrian
    Kouame, Denis
    [J]. 2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 73 - 76