3D medical image registration based on simplified Transformer block and multi-scale iterative structure

被引:0
|
作者
Niu, Yiwei [1 ]
Tao, Zaiyang [1 ]
Han, Tingting [1 ]
Peng, Danyang [1 ]
Zhang, Zhengwei [2 ]
Wu, Jun [1 ,3 ]
机构
[1] AnHui Univ, Informat Mat & Intelligent Sensing Lab Anhui Prov, Hefei, Peoples R China
[2] Anhui Univ Chinese Med, Neurosurg, Affiliated Hosp 1, Hefei, Peoples R China
[3] China Elect Technol Grp, Res Inst 38, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
image registration; attention; multi-scale;
D O I
10.1109/ICIPMC62364.2024.10586687
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The registration of large deformation medical images is a challenging task, due to some conditions during image acquisition, the image will produce large deformation, such as myocardial dilatation. Most of the existing registration models adopt multi- layer pyramid structure, which leads to the loss of feature information when combined at different scales. We propose a multi-scale iterative structural model of Transformer-CNN, which has the advantages of Transformer to obtain remote information while simplifying modules and reducing the number of model parameters. The multi-scale iterative structure of CNN can obtain local information and connect feature information at different scales. Experimental results on medical image datasets show that the proposed method has excellent performance in terms of registration accuracy, which is superior to the existing registration methods, while reducing the number of model parameters to a certain extent.
引用
收藏
页码:101 / 105
页数:5
相关论文
共 50 条
  • [11] Deformable 3D medical image registration with convolutional neural network and transformer
    Deng, Liwei
    Zou, Yanchao
    Huang, Sijuan
    Yang, Xin
    Wang, Jing
    JOURNAL OF INSTRUMENTATION, 2023, 18 (04)
  • [12] Grouped multi-scale vision transformer for medical image segmentation
    Zexuan Ji
    Zheng Chen
    Xiao Ma
    Scientific Reports, 15 (1)
  • [13] A lightweight multi-scale multi-angle dynamic interactive transformer-CNN fusion model for 3D medical image segmentation
    Hua, Xin
    Du, Zhijiang
    Yu, Hongjian
    Ma, Jixin
    Zheng, Fanjun
    Zhang, Chen
    Lu, Qiaohui
    Zhao, Hui
    NEUROCOMPUTING, 2024, 608
  • [14] MSIT-Det: Multi-Scale Feature Aggregation with Iterative Transformer Networks for 3D Object Detection
    Li, Xi
    Chen, Yuanyuan
    Lv, Yisheng
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 5510 - 5515
  • [15] A Robust Medical Image Registration Algorithm Based on The SAM of Multi-Scale Harris Corners
    Ding, Ying
    Fan, Jing-tao
    Yang, Hua-min
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS, VOLS 1-4, 2009, : 1550 - +
  • [16] MPCT: A medical image fusion method based on multi-scale pyramid convolution and Transformer
    Xu, Yi
    Wang, Zijie
    Wu, Shoucai
    Zhan, Xiongfei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 101
  • [17] HYPERSPECTRAL IMAGE CHANGE DETECTION BASED ON MULTI-SCALE 3D CONVOLUTION AUTOENCODER
    Tang, Yingjie
    Fan, Yuanze
    Feng, Shou
    Zhao, Chunhui
    Luo, Tianfang
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3211 - 3214
  • [18] Multi-scale 3D image-based modelling of a carbon/carbon composite
    Alghamdi, A.
    Mummery, P.
    Sheikh, M. A.
    MODELLING AND SIMULATION IN MATERIALS SCIENCE AND ENGINEERING, 2013, 21 (08)
  • [19] MESTrans: Multi-scale embedding spatial transformer for medical image segmentation
    Liu, Yatong
    Zhu, Yu
    Xin, Ying
    Zhang, Yanan
    Yang, Dawei
    Xu, Tao
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 233
  • [20] HMTN: Hierarchical Multi-scale Transformer Network for 3D Shape Recognition
    Zhao, Yue
    Nie, Weizhi
    Gao, Zan
    Liu, An-an
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022,