A cross-view geo-localization method guided by relation-aware global attention

被引:2
|
作者
Sun, Jing [1 ]
Yan, Rui [1 ]
Zhang, Bing [1 ]
Zhu, Bing [2 ]
Sun, Fuming [1 ]
机构
[1] Dalian Minzu Univ, Sch Informat & Commun Engn, Liaohe West Rd, Dalian 116600, Liaoning, Peoples R China
[2] Harbin Inst Technol, Dept Informat Engn, Xidazhi St, Harbin 150006, Heilongjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-view geo-localization; Attention mechanism; Dual-branch structure; Dilated convolution;
D O I
10.1007/s00530-023-01101-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Cross-view geo-localization mainly exploits query images to match images from the same geographical location from different platforms. Most existing methods fail to adequately consider the effect of image structural information on cross-view geo-localization, resulting in the extracted features can not fully characterize the image, which affects the localization accuracy. Based on this, this paper proposes a cross-view geo-localization method guided by relation-aware global attention, which can capture the rich global structural information by perfectly integrating attention mechanism and feature extraction network, thus improving the representation ability of features. Meanwhile, considering the important role of semantic and context information in geo-localization, a joint training structure with parallel global branch and local branch is designed to fully mine multi-scale context features for image matching, which can further improve the accuracy of cross-view geo-localization. The quantitative and qualitative experimental results on University-1652, CVUSA, and CVACT datasets show that the algorithm in this paper outperforms other advanced methods in recall accuracy (Recall) and image retrieval average precision (AP).
引用
收藏
页码:2205 / 2216
页数:12
相关论文
共 50 条
  • [1] A cross-view geo-localization method guided by relation-aware global attention
    Jing Sun
    Rui Yan
    Bing Zhang
    Bing Zhu
    Fuming Sun
    [J]. Multimedia Systems, 2023, 29 : 2205 - 2216
  • [2] Feature Relation Guided Cross-View Image Based Geo-Localization
    Hou, Qingfeng
    Lu, Jun
    Guo, Haitao
    Liu, Xiangyun
    Gong, Zhihui
    Zhu, Kun
    Ping, Yifan
    [J]. REMOTE SENSING, 2023, 15 (20)
  • [3] Cross-View Geo-Localization: A Survey
    Durgam, Abhilash
    Paheding, Sidike
    Dhiman, Vikas
    Devabhaktuni, Vijay
    [J]. IEEE Access, 2024, 12 : 192028 - 192050
  • [4] AFPN: Attention-guided Feature Partition Network for Cross-view Geo-localization
    Lin, Zhifeng
    Huang, Ranran
    Cai, Jiancheng
    Liu, Xinmin
    Ding, Changxing
    Chai, Zhenhua
    [J]. PROCEEDINGS OF THE 2023 WORKSHOP ON UAVS IN MULTIMEDIA: CAPTURING THE WORLD FROM A NEW PERSPECTIVE, UAVM 2023, 2023, : 39 - 44
  • [5] AENet: attention efficient network for cross-view image geo-localization
    Xu, Jingqian
    Zhu, Ma
    Qi, Baojun
    Li, Jiangshan
    Yang, Chunfang
    [J]. ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (07): : 4119 - 4138
  • [6] Cross-View Image Sequence Geo-localization
    Zhang, Xiaohan
    Sultani, Waqas
    Wshah, Safwan
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2913 - 2922
  • [7] GAMa: Cross-View Video Geo-Localization
    Vyas, Shruti
    Chen, Chen
    Shah, Mubarak
    [J]. COMPUTER VISION, ECCV 2022, PT XXXVII, 2022, 13697 : 440 - 456
  • [8] Cross-view geo-localization with evolving transformer
    Yang, Hongji
    Lu, Xiufan
    Zhu, Yingying
    [J]. arXiv, 2021,
  • [9] A Part-aware Attention Neural Network for Cross-view Geo-localization between UAV and Satellite
    Bui, Duc Viet
    Kubo, Masao
    Sato, Hiroshi
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2022, 9 (03): : 275 - 284
  • [10] UAV Geo-Localization Dataset and Method Based on Cross-View Matching
    Yao, Yuwen
    Sun, Cheng
    Wang, Tao
    Yang, Jianxing
    Zheng, Enhui
    [J]. Sensors, 2024, 24 (21)