Large-Deformation 3D Medical Image Registration Based on Multi-Scale Constraints

被引:0
|
作者
Shen Yu [1 ]
Wei Ziyi [1 ]
Yan Yuan [2 ]
Bai Shan [1 ]
Li Yangyang [1 ]
Li Bohao [1 ]
Gao Baoqu [1 ]
Qiang Zhenkai [1 ]
Yan Jiarong [1 ]
机构
[1] Sch Elect & Informat Engn, Lanzhou 730070, Gansu, Peoples R China
[2] Northwest Res Inst Co Ltd CREC, Lanzhou 730099, Gansu, Peoples R China
来源
关键词
image registration; multi-scale constraints; large-deformation image; brain MRI image; abdominal CT image;
D O I
10.3788/CJL241180
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Objective Medical image registration is a spatial transformation process that aligns and matches the specific spatial structures contained in two medical images. It has been applied in disease detection, surgical diagnosis and treatment, and other fields. Traditional medical image registration methods are slow and computationally expensive. In recent years, researchers have made significant breakthroughs in medical image registration research using deep learning methods. Deep learning methods have increased the registration speed by hundreds of times, with a registration accuracy comparable to those of traditional methods. However, most patients have complex pathological conditions and lesions grow quickly, resulting in significant differences in the images collected at different stages. Existing deep learning-based registration methods have low registration accuracy and poor generalization performance when used for medical images of large deformations. Therefore, a multi-scale constraint network (MC-Net) for large-deformation 3D medical image registration Based on multi-scale constraints is proposed. Methods We propose a multi-scale constraint network (MC-Net) for large-deformation 3D medical image registration based on multi-scale constraints. Three multi-kernel (MK) modules are designed as parallel multi-channel and multi-convolution kernels for the encoder to accelerate the training speed. A convolutional block attention module (CBAM) is added to skip connections and enhance the ability to extract complex semantic information and fine-grained feature information from large-deformation images. In order to improve the registration accuracy, MC-Net combines multi-scale constrained loss functions to implement a layer-by-layer optimization strategy from low resolution to high resolution. Results and Discussions In an experiment, three publicly available 3D datasets (OASIS, LPBA40, and Abdomen CT-CT, with two modalities) were used for registration research. The effectiveness of MC-Net was demonstrated through original experiments, traditional comparison methods, deep learning comparison methods , ablation experiments, and multi-core fusion experiments. Based on the registration results shown in Figs. 5 and 6, MC-Net performed well in the registration of the OASIS and LPBA40 brain datasets, as well as for the Abdomen CT-CT abdominal dataset. In the brain image comparison experiment, the LPBA40 brain dataset was compared with a traditional registration method (ANTs) and three deep learning registration methods (VoxelMorph, CycleMorph, and TransMorph) in the same experimental environment. It was found that MC-Net outperformed the other methods in terms of detail registration in brain regions and overall brain contour deformation. The abdominal image comparison experiment compared two traditional methods (ANTs and Elastix) and two deep learning methods (VoxelMorph and TransMorph). It was found that MC-Net had some shortcomings in organ generation and contour deformation, but had better registration performance than the other methods in terms of blank area size and individual organ deformation. The ablation experiment was conducted using the LPBA40 dataset. It demonstrated the different roles of the MK and CBAM modules in processing medical images in MC-Net, which helped to improve the registration accuracy. In addition, this article also discusses the computational complexity of MC-Net. For For large target images such as medical images, this article discusses how a multi-kernel (MK) fusion module can be designed to effectively reduce the computational complexity. Conclusions In response to the low accuracy and poor generalization performance of current large-deformation image registration methods, this paper proposes a medical image registration network (MC-Net) based on multi-scale constraints, with LPBA40, OASIS, and Abdomen CT-CT medical image datasets used as research objects. Information loss can be avoided by designing CBAM modules in skip connections to enhance the ability to extract differential information from large-deformation images. In addition, considering the slow registration speed caused by the large number of parameters when processing large-deformation images, the MK module was designed with a parallel path large kernel convolution structure to improve the registration speed without affecting registration accuracy. When combined with the multi-scale constraint loss function proposed in this article, it iteratively optimizes the deformation fields at three scales from low resolution to high resolution to improve the registration accuracy. The experimental results show that compared with other methods, this method has improved registration accuracy, speed, and computational complexity. The good registration performances in three datasets with MRI and CT modalities demonstrate the generalization ability of our method. Subsequent research will focus on designing an adaptive adjustment module for multi-scale constrained loss function hyperparameters, in order to solve the problem of the time-consuming hyperparameter tuning needed for loss functions in experiments and improve the experimental efficiency. In summary, MC-Net has practical value in the registration of large-deformation images.
引用
收藏
页数:12
相关论文
共 22 条
  • [1] Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain
    Avants, B. B.
    Epstein, C. L.
    Grossman, M.
    Gee, J. C.
    [J]. MEDICAL IMAGE ANALYSIS, 2008, 12 (01) : 26 - 41
  • [2] VoxelMorph: A Learning Framework for Deformable Medical Image Registration
    Balakrishnan, Guha
    Zhao, Amy
    Sabuncu, Mert R.
    Guttag, John
    Dalca, Adrian, V
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) : 1788 - 1800
  • [3] Registration of 3D medical images based on unsupervised cooperative cascade of deep networks
    Cai, Gangcheng
    Liu, Huaying
    Zou, Wei
    Hu, Nan
    Wang, JiaJun
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 82
  • [4] AMNet: Adaptive multi-level network for deformable registration of 3D brain MR images
    Che, Tongtong
    Wang, Xiuying
    Zhao, Kun
    Zhao, Yan
    Zeng, Debin
    Li, Qiongling
    Zheng, Yuanjie
    Yang, Ning
    Wang, Jian
    Li, Shuyu
    [J]. MEDICAL IMAGE ANALYSIS, 2023, 85
  • [5] TransMorph: Transformer for unsupervised medical image registration
    Chen, Junyu
    Frey, Eric C.
    He, Yufan
    Segars, William P.
    Li, Ye
    Du, Yong
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 82
  • [6] Deep learning-based 3D brain multimodal medical image registration
    Deng, Liwei
    Lan, Qi
    Zhi, Qiang
    Huang, Sijuan
    Wang, Jing
    Yang, Xin
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2024, 62 (02) : 505 - 519
  • [7] The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism
    Di Martino, A.
    Yan, C-G
    Li, Q.
    Denio, E.
    Castellanos, F. X.
    Alaerts, K.
    Anderson, J. S.
    Assaf, M.
    Bookheimer, S. Y.
    Dapretto, M.
    Deen, B.
    Delmonte, S.
    Dinstein, I.
    Ertl-Wagner, B.
    Fair, D. A.
    Gallagher, L.
    Kennedy, D. P.
    Keown, C. L.
    Keysers, C.
    Lainhart, J. E.
    Lord, C.
    Luna, B.
    Menon, V.
    Minshew, N. J.
    Monk, C. S.
    Mueller, S.
    Mueller, R. A.
    Nebel, M. B.
    Nigg, J. T.
    O'Hearn, K.
    Pelphrey, K. A.
    Peltier, S. J.
    Rudie, J. D.
    Sunaert, S.
    Thioux, M.
    Tyszka, J. M.
    Uddin, L. Q.
    Verhoeven, J. S.
    Wenderoth, N.
    Wiggins, J. L.
    Mostofsky, S. H.
    Milham, M. P.
    [J]. MOLECULAR PSYCHIATRY, 2014, 19 (06) : 659 - 667
  • [8] Gao X R, 2022, 2022 IEEE 19 INT S B, P1
  • [9] Jaderberg M, 2016, Arxiv, DOI arXiv:1506.02025
  • [10] U-Net vs Transformer: Is U-Net Outdated in Medical Image Registration?
    Jia, Xi
    Bartlett, Joseph
    Zhang, Tianyang
    Lu, Wenqi
    Qiu, Zhaowen
    Duan, Jinming
    [J]. MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2022, 2022, 13583 : 151 - 160