Similarity attention-based CNN for robust 3D medical image registration

被引:6
|
作者
Zhu, Fei [1 ,2 ]
Wang, Sheng [1 ,2 ]
Li, Dun [3 ]
Li, Qiang [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Britton Chance Ctr Biomed Photon, Wuhan Natl Lab Optoelect, Wuhan, Hubei, Peoples R China
[2] Huazhong Univ Sci & Technol, Collaborat Innovat Ctr Biomed Engn, Sch Engn Sci, MoE Key Lab Biomed Photon, Wuhan, Hubei, Peoples R China
[3] United Imaging Surg Healthcare Co Ltd, Shanghai, Peoples R China
关键词
Convolutional neural network; Medical image registration; Similarity; Attention; Multi; -scale; DEFORMABLE REGISTRATION; DOSE ACCUMULATION; MOTION; CONSTRUCTION; DESCRIPTOR; FRAMEWORK; ATLAS; MODEL;
D O I
10.1016/j.bspc.2022.104403
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
In recent years, deep learning (DL)-based registration technology has significantly improved the calculation speed of medical image registration. Existing DL-based registration methods generally use raw data features to predict the deformation field. However, this strategy may not be very effective for difficult registration tasks. Hence, in this study, we propose a similarity attention-based convolutional neural network (CNN) for accurate and robust three-dimensional medical image registration. We first introduce a similarity-based local attention model as an auxiliary module for building a displacement searching space, instead of a direct displacement prediction based on raw data. The proposed model can help the network focus on spatial correspondences with high similarities and ignore those with low similarities. A multi-scale CNN is then integrated with the similaritybased local attention for providing non-local attention, lightweight network, and coarse-to-fine registration. We evaluated the proposed method for various applications, such as the registration of large-scope abdominal computerized tomography (CT) images and chest CT images acquired at different respiratory phases, and atlas registration in magnetic resonance imaging. The experimental results demonstrate that the proposed method can provide a more accurate and robust registration performance than state-of-the-art registration methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] An efficient similarity metric for 3D medical image registration
    Sengupta, Debapriya
    Gupta, Phalguni
    Biswas, Arindam
    [J]. Multimedia Tools and Applications, 83 (40): : 87987 - 88017
  • [2] Conditional GAN with an Attention-Based Generator and a 3D Discriminator for 3D Medical Image Generation
    Jung, Euijin
    Luna, Miguel
    Park, Sang Hyun
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 318 - 328
  • [3] Conditional GAN with an Attention-Based Generator and a 3D Discriminator for 3D Medical Image Generation
    Jung, Euijin
    Luna, Miguel
    Park, Sang Hyun
    [J]. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2021, 12906 LNCS : 318 - 328
  • [4] Attention Guided Policy Optimization for 3D Medical Image Registration
    Hu, Jing
    Shuai, Zhikun
    Wang, Xin
    Hu, Shu
    Sun, Shanhui
    Lyu, Siwei
    Wu, Xi
    [J]. IEEE ACCESS, 2023, 11 : 65546 - 65558
  • [5] A similarity measure based on Tchebichef moments for 2D/3D medical image registration
    Yang, XH
    Birkfellner, W
    Niederer, P
    [J]. CARS 2004: COMPUTER ASSISTED RADIOLOGY AND SURGERY, PROCEEDINGS, 2004, 1268 : 153 - 158
  • [6] A robust image-based method for 3D registration
    Li, T
    [J]. FIFTH INTERNATIONAL CONFERENCE ON 3-D DIGITAL IMAGING AND MODELING, PROCEEDINGS, 2005, : 270 - 276
  • [7] Attention-based 3D Object Reconstruction from a Single Image
    Salvi, Andrey
    Gavenski, Nathan
    Pooch, Eduardo
    Tasoniero, Felipe
    Barros, Rodrigo
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [8] Similarity measures in voxel intensity based 3D multi-modal medical image registration
    Qin, Bin-Jie
    Zhuang, Tian-Ge
    [J]. Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2002, 36 (07): : 942 - 945
  • [9] Triple-UNet with attention-based technique for deformable medical image registration
    Hussain, Naeem
    Yan, Zhiyue
    Cao, Wenming
    [J]. Journal of Electronic Imaging, 2024, 33 (05)
  • [10] Attention-based 3D convolutional networks
    Ding, Enjie
    Xu, Dawei
    Zhao, Yingfei
    Liu, Zhongyu
    Liu, Yafeng
    [J]. JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2023, 35 (01) : 93 - 108