A cross-view geo-localization method guided by relation-aware global attention

被引:2
|
作者
Sun, Jing [1 ]
Yan, Rui [1 ]
Zhang, Bing [1 ]
Zhu, Bing [2 ]
Sun, Fuming [1 ]
机构
[1] Dalian Minzu Univ, Sch Informat & Commun Engn, Liaohe West Rd, Dalian 116600, Liaoning, Peoples R China
[2] Harbin Inst Technol, Dept Informat Engn, Xidazhi St, Harbin 150006, Heilongjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-view geo-localization; Attention mechanism; Dual-branch structure; Dilated convolution;
D O I
10.1007/s00530-023-01101-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Cross-view geo-localization mainly exploits query images to match images from the same geographical location from different platforms. Most existing methods fail to adequately consider the effect of image structural information on cross-view geo-localization, resulting in the extracted features can not fully characterize the image, which affects the localization accuracy. Based on this, this paper proposes a cross-view geo-localization method guided by relation-aware global attention, which can capture the rich global structural information by perfectly integrating attention mechanism and feature extraction network, thus improving the representation ability of features. Meanwhile, considering the important role of semantic and context information in geo-localization, a joint training structure with parallel global branch and local branch is designed to fully mine multi-scale context features for image matching, which can further improve the accuracy of cross-view geo-localization. The quantitative and qualitative experimental results on University-1652, CVUSA, and CVACT datasets show that the algorithm in this paper outperforms other advanced methods in recall accuracy (Recall) and image retrieval average precision (AP).
引用
收藏
页码:2205 / 2216
页数:12
相关论文
共 50 条
  • [21] Geographic Semantic Network for Cross-View Image Geo-Localization
    Zhu, Yingying
    Sun, Bin
    Lu, Xiufan
    Jia, Sen
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [22] Cross-view Geo-localization Based on Cross-domain Matching
    Wu, Xiaokang
    Ma, Qianguang
    Li, Qi
    Yu, Yuanlong
    Liu, Wenxi
    [J]. ADVANCES IN NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, ICNC-FSKD 2022, 2023, 153 : 719 - 728
  • [23] Optimal Feature Transport for Cross-View Image Geo-Localization
    Shi, Yujiao
    Yu, Xin
    Liu, Liu
    Zhang, Tong
    Li, Hongdong
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11990 - 11997
  • [24] Cross-view Geo-localization with Layer-to-Layer Transformer
    Yang, Hongji
    Lu, Xiufan
    Zhu, Yingying
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [25] CAMP: A Cross-View Geo-Localization Method Using Contrastive Attributes Mining and Position-Aware Partitioning
    Wu, Qiong
    Wan, Yi
    Zheng, Zhi
    Zhang, Yongjun
    Wang, Guangshuai
    Zhao, Zhenyang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [26] An Efficient Method based on Multi-view Semantic Alignment for Cross-view Geo-localization
    Wang, Yifeng
    Xia, Yamei
    Lu, Tianbo
    Zhang, Xiaoyan
    Yao, Wenbin
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [27] Joint Representation Learning and Keypoint Detection for Cross-View Geo-Localization
    Lin, Jinliang
    Zheng, Zhedong
    Zhong, Zhun
    Luo, Zhiming
    Li, Shaozi
    Yang, Yi
    Sebe, Nicu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3780 - 3792
  • [28] Cross-View Object Geo-Localization in a Local Region With Satellite Imagery
    Sun, Yuxi
    Ye, Yunming
    Kang, Jian
    Fernandez-Beltran, Ruben
    Feng, Shanshan
    Li, Xutao
    Luo, Chuyao
    Zhang, Puzhao
    Plaza, Antonio
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [29] Bridging Viewpoints in Cross-View Geo-Localization With Siamese Vision Transformer
    Ahn, Woo-Jin
    Park, So-Yeon
    Pae, Dong-Sung
    Choi, Hyun-Duck
    Lim, Myo-Taeg
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [30] Learning Cross-View Visual Geo-Localization Without Ground Truth
    Li, Haoyuan
    Xu, Chang
    Yang, Wen
    Yu, Huai
    Xia, Gui-Song
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62