Similarity attention-based CNN for robust 3D medical image registration

被引:6
|
作者
Zhu, Fei [1 ,2 ]
Wang, Sheng [1 ,2 ]
Li, Dun [3 ]
Li, Qiang [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Britton Chance Ctr Biomed Photon, Wuhan Natl Lab Optoelect, Wuhan, Hubei, Peoples R China
[2] Huazhong Univ Sci & Technol, Collaborat Innovat Ctr Biomed Engn, Sch Engn Sci, MoE Key Lab Biomed Photon, Wuhan, Hubei, Peoples R China
[3] United Imaging Surg Healthcare Co Ltd, Shanghai, Peoples R China
关键词
Convolutional neural network; Medical image registration; Similarity; Attention; Multi; -scale; DEFORMABLE REGISTRATION; DOSE ACCUMULATION; MOTION; CONSTRUCTION; DESCRIPTOR; FRAMEWORK; ATLAS; MODEL;
D O I
10.1016/j.bspc.2022.104403
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
In recent years, deep learning (DL)-based registration technology has significantly improved the calculation speed of medical image registration. Existing DL-based registration methods generally use raw data features to predict the deformation field. However, this strategy may not be very effective for difficult registration tasks. Hence, in this study, we propose a similarity attention-based convolutional neural network (CNN) for accurate and robust three-dimensional medical image registration. We first introduce a similarity-based local attention model as an auxiliary module for building a displacement searching space, instead of a direct displacement prediction based on raw data. The proposed model can help the network focus on spatial correspondences with high similarities and ignore those with low similarities. A multi-scale CNN is then integrated with the similaritybased local attention for providing non-local attention, lightweight network, and coarse-to-fine registration. We evaluated the proposed method for various applications, such as the registration of large-scope abdominal computerized tomography (CT) images and chest CT images acquired at different respiratory phases, and atlas registration in magnetic resonance imaging. The experimental results demonstrate that the proposed method can provide a more accurate and robust registration performance than state-of-the-art registration methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Deep learning-based 3D brain multimodal medical image registration
    Deng, Liwei
    Lan, Qi
    Zhi, Qiang
    Huang, Sijuan
    Wang, Jing
    Yang, Xin
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2024, 62 (02) : 505 - 519
  • [42] A Robust Algorithm of Encrypted Medical Image Retrieval Based on 3D DFT
    Wang, Shuangshuang
    Li, Jingbing
    Zhang, Chunyan
    Wang, Zhaohui
    [J]. SMART HEALTH, ICSH 2016, 2017, 10219 : 238 - 250
  • [43] The Robust Algorithm of 3D Medical Image Retrieval Based on Perceptual Hashing
    Xu, Lian
    Li, Jingbing
    Huang, Mengxing
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON MECHATRONICS, ELECTRONIC, INDUSTRIAL AND CONTROL ENGINEERING, 2015, 8 : 452 - 456
  • [44] A comparison of similarity measures for use in 2-D-3-D medical image registration
    Penney, GP
    Weese, J
    Little, JA
    Desmedt, P
    Hill, DLG
    Hawkes, DJ
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 1998, 17 (04) : 586 - 595
  • [45] A comparison of similarity measures for use in 2D-3D medical image registration
    Penney, GP
    Weese, J
    Little, JA
    Desmedt, P
    Hill, DLG
    Hawkes, DJ
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI'98, 1998, 1496 : 1153 - 1161
  • [46] Dual Channel‐Spatial Self‐Attention Transformer and CNN synergy network for 3D medical image segmentation
    Yang, Fan
    Wang, Bo
    [J]. Applied Soft Computing, 2024, 167
  • [47] Voxel similarity measures for 3D serial MR brain image registration
    Holden, M
    Hill, DLG
    Denton, ERE
    Jarosz, JM
    Cox, TCS
    Hawkes, DJ
    [J]. INFORMATION PROCESSING IN MEDICAL IMAGING, PROCEEDINGS, 1999, 1613 : 472 - 477
  • [48] An Attention-Based CNN for ECG Classification
    Kuvaev, Alexander
    Khudorozhkov, Roman
    [J]. ADVANCES IN COMPUTER VISION, CVC, VOL 1, 2020, 943 : 671 - 677
  • [49] Learning Similarity Measure for Multi-Modal 3D Image Registration
    Lee, Daewon
    Hofmann, Matthias
    Steinke, Florian
    Altun, Yasemin
    Cahill, Nathan D.
    Schoelkopf, Bernhard
    [J]. CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 186 - +
  • [50] Learning deep similarity metric for 3D MR–TRUS image registration
    Grant Haskins
    Jochen Kruecker
    Uwe Kruger
    Sheng Xu
    Peter A. Pinto
    Brad J. Wood
    Pingkun Yan
    [J]. International Journal of Computer Assisted Radiology and Surgery, 2019, 14 : 417 - 425