Detector-Free Feature Matching for Optical and SAR Images Based on a Two-Step Strategy

被引:3
|
作者
Xiang, Yuming [1 ,2 ,3 ]
Jiang, Liting [1 ,2 ,3 ]
Wang, Feng [1 ,2 ]
You, Hongjian [1 ,2 ]
Qiu, Xiaolan [4 ,5 ]
Fu, Kun [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applica, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100049, Peoples R China
[4] Chinese Acad Sci, Natl Key Lab Microwave Imaging, Beijing 100190, Peoples R China
[5] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
关键词
Detector-free; graphics processing unit (GPU); image matching; multimodal; synthetic aperture radar (SAR); DEEP; FRAMEWORK;
D O I
10.1109/TGRS.2024.3409750
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Optical and synthetic aperture radar (SAR) image matching presents a formidable challenge due to their pronounced geometric and radiometric distinctions arising from multimodality. The distinct imaging mechanisms of optical and SAR sensors make it challenging to identify essentially homologous points in the physical sense, raising concerns about the accuracy and repeatability of correspondences in current feature matching methods. In this study, we introduce a detector-free feature matching algorithm specifically designed to match optical and SAR images through a two-step strategy. In the initial phase, our proposed method conducts pixelwise matching (PM) using downsampled feature descriptors, eliminating the necessity to identify repeatable keypoints. To mitigate complexity, we enforce a pseudo-epipolar constraint (PEC) to reduce computational costs by constraining the search range. Subsequently, refined matching is performed on the initial correspondences to rectify inaccuracies in the PM localization of the first step. Both matching steps are implemented on a graphics processing unit (GPU) to ensure high efficiency. The proposed algorithm attains an average matching accuracy of 2.39 pixels and operates with an efficiency of 1.09 s for 1108 image pairs, underscoring its superior comprehensive performance compared to various state-of-the-art algorithms, including handcrafted methods and deep learning networks.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] FeMIP: detector-free feature matching for multimodal images with policy gradient
    Yide Di
    Yun Liao
    Hao Zhou
    Kaijun Zhu
    Yijia Zhang
    Qing Duan
    Junhui Liu
    Mingyu Lu
    Applied Intelligence, 2023, 53 : 24068 - 24088
  • [2] FeMIP: detector-free feature matching for multimodal images with policy gradient
    Di, Yide
    Liao, Yun
    Zhou, Hao
    Zhu, Kaijun
    Zhang, Yijia
    Duan, Qing
    Liu, Junhui
    Lu, Mingyu
    APPLIED INTELLIGENCE, 2023, 53 (20) : 24068 - 24088
  • [3] Local feature matching from detector-based to detector-free: a survey
    Liao, Yun
    Di, Yide
    Zhu, Kaijun
    Zhou, Hao
    Lu, Mingyu
    Zhang, Yijia
    Duan, Qing
    Liu, Junhui
    APPLIED INTELLIGENCE, 2024, 54 (05) : 3954 - 3989
  • [4] Local feature matching from detector-based to detector-free: a survey
    Yun Liao
    Yide Di
    Kaijun Zhu
    Hao Zhou
    Mingyu Lu
    Yijia Zhang
    Qing Duan
    Junhui Liu
    Applied Intelligence, 2024, 54 : 3954 - 3989
  • [5] LoFTR: Detector-Free Local Feature Matching with Transformers
    Sun, Jiaming
    Shen, Zehong
    Wang, Yuang
    Bao, Hujun
    Zhou, Xiaowei
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8918 - 8927
  • [6] ContextMatcher: Detector-Free Feature Matching With Cross-Modality Context
    Li, Dongyue
    Du, Songlin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (09) : 7922 - 7934
  • [7] Region feature based automatic matching for optical and SAR images
    College of Sciences, Zhejiang University, Hangzhou 310027, China
    Zhongguo Kuangye Daxue Xuebao/Journal of China University of Mining and Technology, 2007, 36 (06): : 843 - 847
  • [8] Feature Based Stereo Matching Using Two-Step Expansion
    Wang, Liqiang
    Liu, Zhen
    Zhang, Zhonghua
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2014, 2014
  • [9] A Two-Step Detector Based on Point Spread Function Feature for Multi -channel SAR-GMTI Radar
    Tian, Min
    Yang, Zhiwei
    Dang, HongXing
    Xu, Huajian
    Huang, Penghui
    2016 CIE INTERNATIONAL CONFERENCE ON RADAR (RADAR), 2016,
  • [10] Matching of SAR images and optical images based on edge feature extracted via SVM
    Cheng, H
    Zheng, S
    Yu, QZ
    Tian, JW
    Liu, J
    2004 7TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS 1-3, 2004, : 930 - 933