MixVPR: Feature Mixing for Visual Place Recognition

被引:72
|
作者
Ali-bey, Amar [1 ]
Chaib-draa, Brahim [1 ]
Giguere, Philippe [1 ]
机构
[1] Univ Laval, Quebec City, PQ, Canada
关键词
MODEL;
D O I
10.1109/WACV56688.2023.00301
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual Place Recognition (VPR) is a crucial part of mobile robotics and autonomous driving as well as other computer vision tasks. It refers to the process of identifying a place depicted in a query image using only computer vision. At large scale, repetitive structures, weather and illumination changes pose a real challenge, as appearances can drastically change over time. Along with tackling these challenges, an efficient VPR technique must also be practical in real-world scenarios where latency matters. To address this, we introduce MixVPR, a new holistic feature aggregation technique that takes feature maps from pre-trained backbones as a set of global features. Then, it incorporates a global relationship between elements in each feature map in a cascade of feature mixing, eliminating the need for local or pyramidal aggregation as done in NetVLAD or TransVPR. We demonstrate the effectiveness of our technique through extensive experiments on multiple large-scale benchmarks. Our method outperforms all existing techniques by a large margin while having less than half the number of parameters compared to CosPlace and NetVLAD. We achieve a new all-time high recall@1 score of 94.6% on Pitts250k-test, 88.0% on MapillarySLS, and more importantly, 58.4% on Nordland. Finally, our method outperforms two-stage retrieval techniques such as Patch-NetVLAD, TransVPR and SuperGLUE all while being orders of magnitude faster.
引用
收藏
页码:2997 / 3006
页数:10
相关论文
共 50 条
  • [41] Localizing Discriminative Visual Landmarks for Place Recognition
    Xin, Zhe
    Cai, Yinghao
    Lu, Tao
    Xing, Xiaoxia
    Cai, Shaojun
    Zhang, Jixiang
    Yang, Yiping
    Wang, Yanqing
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 5979 - 5985
  • [42] Encoded Deep Features for Visual Place Recognition
    Hafez, A. H. Abdul
    Alqaraleh, Saed
    Tello, Ammar
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [43] A discriminative approach to robust visual place recognition
    Pronobis, A.
    Caputo, B.
    Jensfelt, P.
    Christensen, H. I.
    2006 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-12, 2006, : 3829 - +
  • [44] A realistic benchmark for visual indoor place recognition
    Pronobis, A.
    Caputo, B.
    Jensfelt, P.
    Christensen, H. I.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2010, 58 (01) : 81 - 96
  • [45] Visual Signature for Place Recognition in Indoor Scenarios
    dos Santos, Filipe Neves
    Costa, Paulo Cerqueira
    Moreira, Antonio Paulo
    CONTROLO'2014 - PROCEEDINGS OF THE 11TH PORTUGUESE CONFERENCE ON AUTOMATIC CONTROL, 2015, 321 : 647 - 656
  • [46] Omnidirectional CNN for Visual Place Recognition and Navigation
    Wang, Tsun-Hsuan
    Huang, Hung-Jui
    Lin, Juan-Ting
    Hu, Chan-Wei
    Zeng, Kuo-Hao
    Sun, Min
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 2341 - 2348
  • [47] Structured Pruning for Efficient Visual Place Recognition
    Grainge, Oliver
    Milford, Michael
    Bodala, Indu
    Ramchurn, Sarvapali D.
    Ehsan, Shoaib
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (02): : 2024 - 2031
  • [48] Long-term Visual Place Recognition
    Alijani, Farid
    Peltomaki, Jukka
    Puura, Jussi
    Huttunen, Heikki
    Kamarainen, Joni-Kristian
    Rahtu, Esa
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3422 - 3428
  • [49] Probabilistic Visual Place Recognition for Hierarchical Localization
    Xu, Ming
    Snderhauf, Niko
    Milford, Michael
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) : 311 - 318
  • [50] Deep Homography Estimation for Visual Place Recognition
    Lu, Feng
    Dong, Shuting
    Zhang, Lijun
    Liu, Bingxi
    Lan, Xiangyuan
    Jiang, Dongmei
    Yuan, Chun
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 9, 2024, : 10341 - 10349