Combining OpenStreetMap with Satellite Imagery to Enhance Cross-View Geo-Localization

被引:0
|
作者
Hu, Yuekun [1 ,2 ,3 ]
Liu, Yingfan [1 ,2 ,3 ]
Hui, Bin [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Optoelect Informat Proc, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang 110016, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
cross-view geo-localization; OpenStreetMap; satellite imagery; data fusion;
D O I
10.3390/s25010044
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Cross-view geo-localization (CVGL) aims to determine the capture location of street-view images by matching them with corresponding 2D maps, such as satellite imagery. While recent bird's eye view (BEV)-based methods have advanced this task by addressing viewpoint and appearance differences, the existing approaches typically rely solely on either OpenStreetMap (OSM) data or satellite imagery, limiting localization robustness due to single-modality constraints. This paper presents a novel CVGL method that fuses OSM data with satellite imagery, leveraging their complementary strengths to enhance localization robustness. We integrate the semantic richness and structural information from OSM with the high-resolution visual details of satellite imagery, creating a unified 2D geospatial representation. Additionally, we employ a transformer-based BEV perception module that utilizes attention mechanisms to construct fine-grained BEV features from street-view images for matching with fused map features. Compared to state-of-the-art methods that utilize only OSM data, our approach achieves substantial improvements, with 12.05% and 12.06% recall enhancements on the KITTI benchmark for lateral and longitudinal localization within a 1-m error, respectively.
引用
收藏
页数:19
相关论文
共 50 条
  • [11] Dual Path Network for Cross-view Geo-Localization
    Dong, Leyi
    Wang, Yuhui
    Huang, Junshi
    Qian, Xueming
    Fan, Mingyuan
    Lai, Shenqi
    PROCEEDINGS OF THE 2023 WORKSHOP ON UAVS IN MULTIMEDIA: CAPTURING THE WORLD FROM A NEW PERSPECTIVE, UAVM 2023, 2023, : 45 - 49
  • [12] Beyond Geo-localization: Fine-grained Orientation of Street-view Images by Cross-view Matching with Satellite Imagery
    Hu, Wenmiao
    Zhang, Yichen
    Liang, Yuxuan
    Yin, Yifang
    Georgescu, Andrei
    Tran, An
    Kruppa, Hannes
    Ng, See-Kiong
    Zimmermann, Roger
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6155 - 6164
  • [13] Lending Orientation to Neural Networks for Cross-view Geo-localization
    Liu, Liu
    Li, Hongdong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5607 - 5616
  • [14] Fusing Geometric and Scene Information for Cross-View Geo-Localization
    Guo, Siyuan
    Liu, Tianying
    Li, Wengen
    Guan, Jihong
    Zhou, Shuigeng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 3978 - 3982
  • [15] Cross-View Image Matching for Geo-localization in Urban Environments
    Tian, Yicong
    Chen, Chen
    Shah, Mubarak
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1998 - 2006
  • [16] Perceptual Feature Fusion Network for Cross-View Geo-Localization
    Wang, Jiayi
    Chen, Ziyang
    Yuan, Xiaochen
    Zhao, Genping
    Computer Engineering and Applications, 60 (03): : 255 - 262
  • [17] Cross-view Geo-localization Based on Cross-domain Matching
    Wu, Xiaokang
    Ma, Qianguang
    Li, Qi
    Yu, Yuanlong
    Liu, Wenxi
    ADVANCES IN NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, ICNC-FSKD 2022, 2023, 153 : 719 - 728
  • [18] Cross-View Visual Geo-Localization for Outdoor Augmented Reality
    Mithun, Niluthpol Chowdhury
    Minhas, Kshitij S.
    Chiu, Han-Pang
    Oskiper, Taragay
    Sizintsev, Mikhail
    Samarasekera, Supun
    Kumar, Rakesh
    2023 IEEE CONFERENCE VIRTUAL REALITY AND 3D USER INTERFACES, VR, 2023, : 493 - 502
  • [19] Geographic Semantic Network for Cross-View Image Geo-Localization
    Zhu, Yingying
    Sun, Bin
    Lu, Xiufan
    Jia, Sen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [20] Cross-view Geo-localization with Layer-to-Layer Transformer
    Yang, Hongji
    Lu, Xiufan
    Zhu, Yingying
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34