Manifold-based feature point matching for multi-modal image registration

被引:5
|
作者
Hu, Liang [1 ,2 ]
Wang, Manning [1 ,2 ]
Song, Zhijian [1 ,2 ]
机构
[1] Fudan Univ, Digital Med Res Ctr, Shanghai 200032, Peoples R China
[2] Shanghai Key Lab Med Image Comp & Comp Assisted I, Shanghai, Peoples R China
关键词
image registration; manifold learning; scale-invariant feature transform; DIMENSIONALITY REDUCTION; MUTUAL-INFORMATION; EIGENMAPS;
D O I
10.1002/rcs.1465
中图分类号
R61 [外科手术学];
学科分类号
摘要
Background Images captured using different modalities usually have significant variations in their intensities, which makes it difficult to reveal their internal structural similarities and achieve accurate registration. Most conventional feature-based image registration techniques are fast and efficient, but they cannot be used directly for the registration of multi-modal images because of these intensity variations. Methods This paper introduces the theory of manifold learning to transform the original images into mono-modal modalities, which is a feature-based method that is applicable to multi-modal image registration. Subsequently, scale-invariant feature transform is used to detect highly distinctive local descriptors and matches between corresponding images, and a point-based registration is executed. Results The algorithm was tested with T1- and T2-weighted magnetic resonance (MR) images obtained from BrainWeb. Both qualitative and quantitative evaluations of the method were performed and the results compared with those produced previously. The experiments showed that feature point matching after manifold learning achieved more accurate results than did the similarity measure for multi-modal image registration. Conclusions This study provides a new manifold-based feature point matching method for multi-modal medical image registration, especially for MR images. The proposed method performs better than do conventional intensity-based techniques in terms of its registration accuracy and is suitable for clinical procedures. Copyright (c) 2012 John Wiley & Sons, Ltd.
引用
收藏
页码:e10 / e18
页数:9
相关论文
共 50 条
  • [31] MixBERT for Multi-modal Matching in Image Advertising
    Yu, Tan
    Li, Xiaokang
    Xie, Jianwen
    Yin, Ruiyang
    Xu, Qing
    Li, Ping
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3597 - 3602
  • [32] Multi-Modal Image Registration Based on Gradient Orientations of Minimal Uncertainty
    De Nigris, Dante
    Collins, D. Louis
    Arbel, Tal
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2012, 31 (12) : 2343 - 2354
  • [33] A MULTI-MODAL AUTOMATIC IMAGE REGISTRATION TECHNIQUE BASED ON COMPLEX WAVELETS
    Ghantous, Milad
    Ghosh, Somik
    Bayoumi, Magdy
    [J]. 2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 173 - 176
  • [34] Image registration in stereo-based multi-modal imaging systems
    Hild, M
    Umeda, G
    [J]. ISPA 2005: PROCEEDINGS OF THE 4TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2005, : 70 - 75
  • [35] Structural Representations for Multi-modal Image Registration Based on Modified Entropy
    Kasiri, Keyvan
    Fieguth, Paul
    Clausi, David A.
    [J]. IMAGE ANALYSIS AND RECOGNITION (ICIAR 2015), 2015, 9164 : 82 - 89
  • [36] Morphological Pyramid Multi-modal Medical Image Registration Based on QPSO
    Huang, Xiaosheng
    Zhang, Fang
    [J]. 2009 INTERNATIONAL ASIA SYMPOSIUM ON INTELLIGENT INTERACTION AND AFFECTIVE COMPUTING, 2009, : 67 - 70
  • [37] The registration of multi-modal point clouds for industrial inspection
    Nooralishahi, Parham
    Pozzer, Sandra
    Ramos, Gabriel
    Lopez, Fernando
    Maldague, Xavier
    [J]. QUANTITATIVE INFRARED THERMOGRAPHY JOURNAL, 2023,
  • [38] Multi-modal and multi-vendor retina image registration
    Li, Zhang
    Huang, Fan
    Zhang, Jiong
    Dashtbozorg, Behdad
    Abbasi-Sureshjani, Samaneh
    Sun, Yue
    Long, Xi
    Yu, Qifeng
    Romeny, Bart ter Haar
    Tan, Tao
    [J]. BIOMEDICAL OPTICS EXPRESS, 2018, 9 (02): : 410 - 422
  • [39] Robust Multi-Scale Multi-modal Image Registration
    Holtzman-Gazit, Michal
    Yavneh, Irad
    [J]. SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION XIX, 2010, 7697
  • [40] Large Eddy Simulation of a turbulent lifted flame using multi-modal manifold-based models: Feasibility and interpretability
    Novoselov, Alex G.
    Lacey, Cristian E.
    Perry, Bruce A.
    Mueller, Michael E.
    [J]. PROCEEDINGS OF THE COMBUSTION INSTITUTE, 2021, 38 (02) : 2581 - 2588