GAMa: Cross-View Video Geo-Localization

被引:4
|
作者
Vyas, Shruti [1 ]
Chen, Chen [1 ]
Shah, Mubarak [1 ]
机构
[1] Univ Cent Florida, Ctr Res Comp Vis, Orlando, FL 32816 USA
来源
关键词
D O I
10.1007/978-3-031-19836-6_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The existing work in cross-view geo-localization is based on images where a ground panorama is matched to an aerial image. In this work, we focus on ground videos instead of images which provides additional contextual cues which are important for this task. There are no existing datasets for this problem, therefore we propose GAMa dataset, a large-scale dataset with ground videos and corresponding aerial images. We also propose a novel approach to solve this problem. At clip-level, a short video clip is matched with corresponding aerial image and is later used to get video-level geo-localization of a long video. Moreover, we propose a hierarchical approach to further improve the clip-level geo-localization. On this challenging dataset, with unaligned images and limited field of view, our proposed method achieves a Top-1 recall rate of 19.4% and 45.1% @1.0mile.
引用
收藏
页码:440 / 456
页数:17
相关论文
共 50 条
  • [41] Spatial-Aware Feature Aggregation for Cross-View Image based Geo-Localization
    Shi, Yujiao
    Liu, Liu
    Yu, Xin
    Li, Hongdong
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [42] Aligning Geometric Spatial Layout in Cross-View Geo-Localization via Feature Recombination
    Zhang, Qingwang
    Zhu, Yingying
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 7251 - 7259
  • [43] VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrieval
    Zhu, Sijie
    Yang, Taojiannan
    Chen, Chen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3639 - 3648
  • [44] Navigating the Metaverse: UAV-Based Cross-View Geo-Localization in Virtual Worlds
    Yagi, Ryota
    Yairi, Takehisa
    Iwasaki, Akira
    [J]. PROCEEDINGS OF THE 2023 WORKSHOP ON UAVS IN MULTIMEDIA: CAPTURING THE WORLD FROM A NEW PERSPECTIVE, UAVM 2023, 2023, : 13 - 17
  • [45] A cross-view geo-localization method guided by relation-aware global attention
    Sun, Jing
    Yan, Rui
    Zhang, Bing
    Zhu, Bing
    Sun, Fuming
    [J]. MULTIMEDIA SYSTEMS, 2023, 29 (04) : 2205 - 2216
  • [46] Learning discriminative representations via variational self-distillation for cross-view geo-localization
    Hu, Qian
    Li, Wansi
    Xu, Xing
    Liu, Ning
    Wang, Lei
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2022, 103
  • [47] Hybrid Perspective Mapping: Align Method for Cross-View Image-Based Geo-Localization
    Wang, Junbo
    Yang, Yi
    Pan, Miaoxin
    Zhang, Man
    Zhu, Minzhao
    Fu, Mengyin
    [J]. 2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 3040 - 3046
  • [48] A Novel Geo-Localization Method for UAV and Satellite Images Using Cross-View Consistent Attention
    Cui, Zhuofan
    Zhou, Pengwei
    Wang, Xiaolong
    Zhang, Zilun
    Li, Yingxuan
    Li, Hongbo
    Zhang, Yu
    [J]. REMOTE SENSING, 2023, 15 (19)
  • [49] Multibranch Joint Representation Learning Based on Information Fusion Strategy for Cross-View Geo-Localization
    Ge, Fawei
    Zhang, Yunzhou
    Liu, Yixiu
    Wang, Guiyuan
    Coleman, Sonya
    Kerr, Dermot
    Wang, Li
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [50] MCCG: A ConvNeXt-Based Multiple-Classifier Method for Cross-View Geo-Localization
    Shen, Tianrui
    Wei, Yingmei
    Kang, Lai
    Wan, Shanshan
    Yang, Yee-Hong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1456 - 1468