Large-Deformation 3D Medical Image Registration Based on Multi-Scale Constraints

被引:0
|
作者
Shen Yu [1 ]
Wei Ziyi [1 ]
Yan Yuan [2 ]
Bai Shan [1 ]
Li Yangyang [1 ]
Li Bohao [1 ]
Gao Baoqu [1 ]
Qiang Zhenkai [1 ]
Yan Jiarong [1 ]
机构
[1] Sch Elect & Informat Engn, Lanzhou 730070, Gansu, Peoples R China
[2] Northwest Res Inst Co Ltd CREC, Lanzhou 730099, Gansu, Peoples R China
来源
关键词
image registration; multi-scale constraints; large-deformation image; brain MRI image; abdominal CT image;
D O I
10.3788/CJL241180
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Objective Medical image registration is a spatial transformation process that aligns and matches the specific spatial structures contained in two medical images. It has been applied in disease detection, surgical diagnosis and treatment, and other fields. Traditional medical image registration methods are slow and computationally expensive. In recent years, researchers have made significant breakthroughs in medical image registration research using deep learning methods. Deep learning methods have increased the registration speed by hundreds of times, with a registration accuracy comparable to those of traditional methods. However, most patients have complex pathological conditions and lesions grow quickly, resulting in significant differences in the images collected at different stages. Existing deep learning-based registration methods have low registration accuracy and poor generalization performance when used for medical images of large deformations. Therefore, a multi-scale constraint network (MC-Net) for large-deformation 3D medical image registration Based on multi-scale constraints is proposed. Methods We propose a multi-scale constraint network (MC-Net) for large-deformation 3D medical image registration based on multi-scale constraints. Three multi-kernel (MK) modules are designed as parallel multi-channel and multi-convolution kernels for the encoder to accelerate the training speed. A convolutional block attention module (CBAM) is added to skip connections and enhance the ability to extract complex semantic information and fine-grained feature information from large-deformation images. In order to improve the registration accuracy, MC-Net combines multi-scale constrained loss functions to implement a layer-by-layer optimization strategy from low resolution to high resolution. Results and Discussions In an experiment, three publicly available 3D datasets (OASIS, LPBA40, and Abdomen CT-CT, with two modalities) were used for registration research. The effectiveness of MC-Net was demonstrated through original experiments, traditional comparison methods, deep learning comparison methods , ablation experiments, and multi-core fusion experiments. Based on the registration results shown in Figs. 5 and 6, MC-Net performed well in the registration of the OASIS and LPBA40 brain datasets, as well as for the Abdomen CT-CT abdominal dataset. In the brain image comparison experiment, the LPBA40 brain dataset was compared with a traditional registration method (ANTs) and three deep learning registration methods (VoxelMorph, CycleMorph, and TransMorph) in the same experimental environment. It was found that MC-Net outperformed the other methods in terms of detail registration in brain regions and overall brain contour deformation. The abdominal image comparison experiment compared two traditional methods (ANTs and Elastix) and two deep learning methods (VoxelMorph and TransMorph). It was found that MC-Net had some shortcomings in organ generation and contour deformation, but had better registration performance than the other methods in terms of blank area size and individual organ deformation. The ablation experiment was conducted using the LPBA40 dataset. It demonstrated the different roles of the MK and CBAM modules in processing medical images in MC-Net, which helped to improve the registration accuracy. In addition, this article also discusses the computational complexity of MC-Net. For For large target images such as medical images, this article discusses how a multi-kernel (MK) fusion module can be designed to effectively reduce the computational complexity. Conclusions In response to the low accuracy and poor generalization performance of current large-deformation image registration methods, this paper proposes a medical image registration network (MC-Net) based on multi-scale constraints, with LPBA40, OASIS, and Abdomen CT-CT medical image datasets used as research objects. Information loss can be avoided by designing CBAM modules in skip connections to enhance the ability to extract differential information from large-deformation images. In addition, considering the slow registration speed caused by the large number of parameters when processing large-deformation images, the MK module was designed with a parallel path large kernel convolution structure to improve the registration speed without affecting registration accuracy. When combined with the multi-scale constraint loss function proposed in this article, it iteratively optimizes the deformation fields at three scales from low resolution to high resolution to improve the registration accuracy. The experimental results show that compared with other methods, this method has improved registration accuracy, speed, and computational complexity. The good registration performances in three datasets with MRI and CT modalities demonstrate the generalization ability of our method. Subsequent research will focus on designing an adaptive adjustment module for multi-scale constrained loss function hyperparameters, in order to solve the problem of the time-consuming hyperparameter tuning needed for loss functions in experiments and improve the experimental efficiency. In summary, MC-Net has practical value in the registration of large-deformation images.
引用
收藏
页数:12
相关论文
共 22 条
  • [11] Dual-stream pyramid registration network
    Kang, Miao
    Hu, Xiaojun
    Huang, Weilin
    Scott, Matthew R.
    Reyes, Mauricio
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 78
  • [12] CycleMorph: Cycle consistent unsupervised deformable image registration
    Kim, Boah
    Kim, Dong Hwan
    Park, Seong Ho
    Kim, Jieun
    Lee, June-Goo
    Ye, Jong Chul
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 71
  • [13] elastix: A Toolbox for Intensity-Based Medical Image Registration
    Klein, Stefan
    Staring, Marius
    Murphy, Keelin
    Viergever, Max A.
    Pluim, Josien P. W.
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2010, 29 (01) : 196 - 205
  • [14] 2D-3D Medical Image Registration Based on Training-Inference Decoupling Architecture
    Li Wenju
    Kong Deqing
    Cao Guogang
    Li Sicheng
    Dai Cuixia
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [15] Non-Rigid Registration Algorithm of Lung Computed Tomography Image Based on Multi-Scale Parallel Fully Convolutional Neural Network
    Lin Lihao
    Yi Jianbing
    Cao Feng
    Fang Wangsheng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [16] Open access series of imaging studies (OASIS): Cross-sectional MRI data in young, middle aged, nondemented, and demented older adults
    Marcus, Daniel S.
    Wang, Tracy H.
    Parker, Jamie
    Csernansky, John G.
    Morris, John C.
    Buckner, Randy L.
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2007, 19 (09) : 1498 - 1507
  • [17] CMAN: Cascaded Multi-scale Spatial Channel Attention-guided Network for large 3D deformable registration of liver CT images
    Pham, Xuan Loc
    Luu, Manh Ha
    van Walsum, Theo
    Mai, Hong Son
    Klein, Stefan
    Le, Ngoc Ha
    Chu, Duc Trinh
    [J]. MEDICAL IMAGE ANALYSIS, 2024, 96
  • [18] The yak genome and adaptation to life at high altitude
    Qiu, Qiang
    Zhang, Guojie
    Ma, Tao
    Qian, Wubin
    Wang, Junyi
    Ye, Zhiqiang
    Cao, Changchang
    Hu, Quanjun
    Kim, Jaebum
    Larkin, Denis M.
    Auvil, Loretta
    Capitanu, Boris
    Ma, Jian
    Lewin, Harris A.
    Qian, Xiaoju
    Lang, Yongshan
    Zhou, Ran
    Wang, Lizhong
    Wang, Kun
    Xia, Jinquan
    Liao, Shengguang
    Pan, Shengkai
    Lu, Xu
    Hou, Haolong
    Wang, Yan
    Zang, Xuetao
    Yin, Ye
    Ma, Hui
    Zhang, Jian
    Wang, Zhaofeng
    Zhang, Yingmei
    Zhang, Dawei
    Yonezawa, Takahiro
    Hasegawa, Masami
    Zhong, Yang
    Liu, Wenbin
    Zhang, Yan
    Huang, Zhiyong
    Zhang, Shengxiang
    Long, Ruijun
    Yang, Huanming
    Wang, Jian
    Lenstra, Johannes A.
    Cooper, David N.
    Wu, Yi
    Wang, Jun
    Shi, Peng
    Wang, Jian
    Liu, Jianquan
    [J]. NATURE GENETICS, 2012, 44 (08) : 946 - +
  • [19] Diffeomorphic demons: Efficient non-parametric image registration
    Vercauteren, Tom
    Pennec, Xavier
    Perchant, Aymeric
    Ayache, Nicholas
    [J]. NEUROIMAGE, 2009, 45 (01) : S61 - S72
  • [20] CBAM: Convolutional Block Attention Module
    Woo, Sanghyun
    Park, Jongchan
    Lee, Joon-Young
    Kweon, In So
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 3 - 19