Combining OpenStreetMap with Satellite Imagery to Enhance Cross-View Geo-Localization

被引:0
|
作者
Hu, Yuekun [1 ,2 ,3 ]
Liu, Yingfan [1 ,2 ,3 ]
Hui, Bin [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Optoelect Informat Proc, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang 110016, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
cross-view geo-localization; OpenStreetMap; satellite imagery; data fusion;
D O I
10.3390/s25010044
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Cross-view geo-localization (CVGL) aims to determine the capture location of street-view images by matching them with corresponding 2D maps, such as satellite imagery. While recent bird's eye view (BEV)-based methods have advanced this task by addressing viewpoint and appearance differences, the existing approaches typically rely solely on either OpenStreetMap (OSM) data or satellite imagery, limiting localization robustness due to single-modality constraints. This paper presents a novel CVGL method that fuses OSM data with satellite imagery, leveraging their complementary strengths to enhance localization robustness. We integrate the semantic richness and structural information from OSM with the high-resolution visual details of satellite imagery, creating a unified 2D geospatial representation. Additionally, we employ a transformer-based BEV perception module that utilizes attention mechanisms to construct fine-grained BEV features from street-view images for matching with fused map features. Compared to state-of-the-art methods that utilize only OSM data, our approach achieves substantial improvements, with 12.05% and 12.06% recall enhancements on the KITTI benchmark for lateral and longitudinal localization within a 1-m error, respectively.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Optimal Feature Transport for Cross-View Image Geo-Localization
    Shi, Yujiao
    Yu, Xin
    Liu, Liu
    Zhang, Tong
    Li, Hongdong
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11990 - 11997
  • [22] A Novel Geo-Localization Method for UAV and Satellite Images Using Cross-View Consistent Attention
    Cui, Zhuofan
    Zhou, Pengwei
    Wang, Xiaolong
    Zhang, Zilun
    Li, Yingxuan
    Li, Hongbo
    Zhang, Yu
    REMOTE SENSING, 2023, 15 (19)
  • [23] UAV Geo-Localization Dataset and Method Based on Cross-View Matching
    Yao, Yuwen
    Sun, Cheng
    Wang, Tao
    Yang, Jianxing
    Zheng, Enhui
    SENSORS, 2024, 24 (21)
  • [24] Enhancing Cross-View Geo-Localization With Domain Alignment and Scene Consistency
    Xia, Panwang
    Wan, Yi
    Zheng, Zhi
    Zhang, Yongjun
    Deng, Jiwei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13271 - 13281
  • [25] Feature Relation Guided Cross-View Image Based Geo-Localization
    Hou, Qingfeng
    Lu, Jun
    Guo, Haitao
    Liu, Xiangyun
    Gong, Zhihui
    Zhu, Kun
    Ping, Yifan
    REMOTE SENSING, 2023, 15 (20)
  • [26] Learning Cross-View Visual Geo-Localization Without Ground Truth
    Li, Haoyuan
    Xu, Chang
    Yang, Wen
    Yu, Huai
    Xia, Gui-Song
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 1
  • [27] Bridging Viewpoints in Cross-View Geo-Localization With Siamese Vision Transformer
    Ahn, Woo-Jin
    Park, So-Yeon
    Pae, Dong-Sung
    Choi, Hyun-Duck
    Lim, Myo-Taeg
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 1
  • [28] Joint Representation Learning and Keypoint Detection for Cross-View Geo-Localization
    Lin, Jinliang
    Zheng, Zhedong
    Zhong, Zhun
    Luo, Zhiming
    Li, Shaozi
    Yang, Yi
    Sebe, Nicu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3780 - 3792
  • [29] LIGHTWEIGHT CNN FOR CROSS-VIEW GEO-LOCALIZATION USING AERIAL IMAGE
    Yagi, Ryota
    Iwasaki, Akira
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6266 - 6269
  • [30] AENet: attention efficient network for cross-view image geo-localization
    Xu, Jingqian
    Zhu, Ma
    Qi, Baojun
    Li, Jiangshan
    Yang, Chunfang
    ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (07): : 4119 - 4138