A CNN-TRANSFORMER HYBRID FEATURE DESCRIPTOR FOR OPTICAL-SAR IMAGE REGISTRATION

被引:0
|
作者
Lin, Mingxin [1 ]
Liu, Binyuan [1 ]
Liu, Yijun [1 ]
Wang, Qingsong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Commun Engn, Guangzhou, Peoples R China
基金
美国国家科学基金会;
关键词
optical-SAR image registration; feature descriptor; CNN; Transformer;
D O I
10.1109/IGARSS52108.2023.10281985
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
This paper presents a CNN-Transformer hybrid feature descriptor for the registration of optical and SAR images. The proposed feature descriptor is composed of a shallow feature extraction module based on CNN and a deep feature extraction module based on Transformer, which are tailored to extract features from different levels. Its effectiveness is demonstrated in experiments with comparison to state-of-the-art methods. Experimental results demonstrated its superior performance compare to the state-of-the-art methods, thus showcasing its efficacy and potential for practical applications. Index
引用
收藏
页码:6069 / 6072
页数:4
相关论文
共 50 条
  • [1] Hybrid CNN-Transformer Feature Fusion for Single Image Deraining
    Chen, Xiang
    Pan, Jinshan
    Lu, Jiyang
    Fan, Zhentao
    Li, Hao
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 378 - 386
  • [2] Image harmonization with Simple Hybrid CNN-Transformer Network
    Li, Guanlin
    Zhao, Bin
    Li, Xuelong
    NEURAL NETWORKS, 2024, 180
  • [3] HCformer: Hybrid CNN-Transformer for LDCT Image Denoising
    Yuan, Jinli
    Zhou, Feng
    Guo, Zhitao
    Li, Xiaozeng
    Yu, Hengyong
    JOURNAL OF DIGITAL IMAGING, 2023, 36 (05) : 2290 - 2305
  • [4] HCformer: Hybrid CNN-Transformer for LDCT Image Denoising
    Jinli Yuan
    Feng Zhou
    Zhitao Guo
    Xiaozeng Li
    Hengyong Yu
    Journal of Digital Imaging, 2023, 36 (5) : 2290 - 2305
  • [5] TFCNs: A CNN-Transformer Hybrid Network for Medical Image Segmentation
    Li, Zihan
    Li, Dihan
    Xu, Cangbai
    Wang, Weice
    Hong, Qingqi
    Li, Qingde
    Tian, Jie
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT IV, 2022, 13532 : 781 - 792
  • [6] SAR image registration with optimized feature descriptor and reliable feature matching
    Wang, Yanzhao
    Su, Juan
    Zhan, Bichao
    Li, Bing
    Wu, Wei
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2017, 10668 LNCS : 621 - 632
  • [7] A hybrid CNN-Transformer model for Historical Document Image Binarization
    Rezanezhad, Vahid
    Baierer, Konstantin
    Neudecker, Clemens
    PROCEEDINGS OF THE 2023 INTERNATIONAL WORKSHOP ON HISTORICAL DOCUMENT IMAGING AND PROCESSING, HIP 2023, 2023, : 79 - 84
  • [8] SAR Image Registration with Optimized Feature Descriptor and Reliable Feature Matching
    Wang, Yanzhao
    Su, Juan
    Zhan, Bichao
    Li, Bing
    Wu, Wei
    IMAGE AND GRAPHICS (ICIG 2017), PT III, 2017, 10668 : 621 - 632
  • [9] Rethinking Image Deblurring via CNN-Transformer Multiscale Hybrid Architecture
    Zhao, Qian
    Yang, Hao
    Zhou, Dongming
    Cao, Jinde
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [10] Hybrid Multiscale SAR Ship Detector With CNN-Transformer and Adaptive Fusion Loss
    Wang, Fei
    Chen, Chengcheng
    Zeng, Weiming
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21