A Transformer-Based Coarse-to-Fine Wide-Swath SAR Image Registration Method under Weak Texture Conditions

被引:20
|
作者
Fan, Yibo [1 ]
Wang, Feng [1 ]
Wang, Haipeng [1 ]
机构
[1] Fudan Univ, Sch Informat Sci & Technol, Key Lab Informat Sci Electromagnet Waves, Minist Educ, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金; 上海市自然科学基金;
关键词
synthetic aperture radar; image registration; transformer; NEURAL-NETWORK;
D O I
10.3390/rs14051175
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
As an all-weather and all-day remote sensing image data source, SAR (Synthetic Aperture Radar) images have been widely applied, and their registration accuracy has a direct impact on the downstream task effectiveness. The existing registration algorithms mainly focus on small sub-images, and there is a lack of available accurate matching methods for large-size images. This paper proposes a high-precision, rapid, large-size SAR image dense-matching method. The method mainly includes four steps: down-sampling image pre-registration, sub-image acquisition, dense matching, and the transformation solution. First, the ORB (Oriented FAST and Rotated BRIEF) operator and the GMS (Grid-based Motion Statistics) method are combined to perform rough matching in the semantically rich down-sampled image. In addition, according to the feature point pairs, a group of clustering centers and corresponding images are obtained. Subsequently, a deep learning method based on Transformers is used to register images under weak texture conditions. Finally, the global transformation relationship can be obtained through RANSAC (Random Sample Consensus). Compared with the SOTA algorithm, our method's correct matching point numbers are increased by more than 2.47 times, and the root mean squared error (RMSE) is reduced by more than 4.16%. The experimental results demonstrate that our proposed method is efficient and accurate, which provides a new idea for SAR image registration.
引用
收藏
页数:25
相关论文
共 39 条
  • [1] Affine Medical Image Registration with Coarse-to-Fine Vision Transformer
    Mok, Tony C. W.
    Chung, Albert C. S.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20803 - 20812
  • [2] Learning based coarse-to-fine image registration
    Jiang, Jiayan
    Zheng, Songfeng
    Toga, Arthur W.
    Tu, Zhuowen
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 429 - +
  • [3] Coarse-to-fine SAR image change detection method
    Wang, Chang
    Zhang, Yongsheng
    Wang, Xu
    REMOTE SENSING LETTERS, 2019, 10 (12) : 1153 - 1162
  • [4] A coarse-to-fine image registration method based on visual attention model
    FENG Jing
    MA Long
    BI FuKun
    ZHANG XueJing
    CHEN He
    ScienceChina(InformationSciences), 2014, 57 (12) : 122 - 131
  • [5] A coarse-to-fine image registration method for moving objects
    Lu, X. (xblu2013@126.com), 1600, Binary Information Press, P.O. Box 162, Bethel, CT 06801-0162, United States (09):
  • [6] A coarse-to-fine image registration method based on visual attention model
    Feng Jing
    Ma Long
    Bi FuKun
    Zhang XueJing
    Chen He
    SCIENCE CHINA-INFORMATION SCIENCES, 2014, 57 (12) : 1 - 10
  • [7] A Coarse-to-Fine Registration Method for Satellite Infrared Image and Visual Image
    Hu Yong-li
    Wang Liang
    Liu Rong
    Zhang Li
    Duan Fu-qing
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2013, 33 (11) : 2968 - 2972
  • [8] A coarse-to-fine image registration method based on autocorrelation structural difference information
    Pang, Bo
    Wang, Lei
    Yang, Qili
    Gao, Haiyun
    Wu, Chunjun
    Zhu, Wenlei
    REMOTE SENSING LETTERS, 2025, 16 (02) : 181 - 190
  • [9] A Robust Coarse-to-Fine Sub-Pixel Registration Method Under Noisy Conditions
    Zhang, Boyang
    Chen, Changbing
    Yan, Hua
    Liu, Wei
    2010 IEEE 10TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS (ICSP2010), VOLS I-III, 2010, : 1094 - +
  • [10] A Coarse-to-Fine Approach for Remote-Sensing Image Registration Based on a Local Method
    Lee, Sang Rok
    INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2010, 3 (04) : 690 - 702