Graph-Based Place Recognition in Image Sequences with CNN Features

被引:32
|
作者
Zhang, Xiwu [1 ,2 ]
Wang, Lei [2 ]
Zhao, Yan [2 ]
Su, Yan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Mech Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
关键词
Visual place recognition; Loop closure detection; SLAM; Deep learning; CNN; Diffusion; FAB-MAP; LOCALIZATION; DIFFUSION; SCALE; SLAM;
D O I
10.1007/s10846-018-0917-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual place recognition is a critical and challenging problem in both robotics and computer vision communities. In this paper, we focus on place recognition for visual Simultaneous Localization and Mapping (vSLAM) systems. These systems have been limited to handcrafted feature based paradigms for a long time, which normally use local visual information of images and are not sufficiently robust against variations applied to images. In this work, we address place recognition with the features automatically learned from data. First, we propose a graph-based visual place recognition method. The graph is constructed by combining the visual features extracted from convolutional neural networks (CNNs) and the temporal information of the images in a sequence. Second, we propose to employ diffusion process to enhance the data association in the graph to achieve more accurate recognition results. Finally, to evaluate the proposed method, we experiment on four commonly used datasets. Experimental results indicate that the proposed method is able to obtain significantly better performance (e.g. 95.37% recall at 100% of precision) than that of FAB-MAP (47.16% recall at 100% of precision), a commonly used method for place recognition based on handcrafted features, especially on some challenging datasets.
引用
收藏
页码:389 / 403
页数:15
相关论文
共 50 条
  • [21] A graph-based table recognition system
    Rahgozar, MA
    Cooperman, R
    DOCUMENT RECOGNITION III, 1996, 2660 : 192 - 203
  • [22] A Graph-based approach for Kite recognition
    Madi, Kamel
    Seba, Hamida
    Kheddouci, Hamamache
    Barge, Olivier
    PATTERN RECOGNITION LETTERS, 2017, 87 : 186 - 194
  • [23] GSAP: A Global Structure Attention Pooling Method for Graph-Based Visual Place Recognition
    Yang, Yukun
    Ma, Bo
    Liu, Xiangdong
    Zhao, Liang
    Huang, Shoudong
    REMOTE SENSING, 2021, 13 (08)
  • [24] Graph-based features for texture discrimination
    Grigorescu, C
    Petkov, N
    15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, PROCEEDINGS: IMAGE, SPEECH AND SIGNAL PROCESSING, 2000, : 1076 - 1079
  • [25] EFFICIENT POOLING OF IMAGE BASED CNN FEATURES FOR ACTION RECOGNITION IN VIDEOS
    Banerjee, Biplab
    Murino, Vittorio
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2637 - 2641
  • [26] Relevance graph-based image retrieval
    Sull, S
    Oh, J
    Oh, S
    Song, SMH
    Lee, SW
    2000 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, PROCEEDINGS VOLS I-III, 2000, : 713 - 716
  • [27] Pattern graph-based image retrieval system combining semantic and visual features
    Olfa Allani
    Hajer Baazaoui Zghal
    Nedra Mellouli
    Herman Akdag
    Multimedia Tools and Applications, 2017, 76 : 20287 - 20316
  • [28] Graph-based Medical Image Clustering
    Li, Jian
    Pan, Haiwei
    Zhang, Minghui
    Han, Qilong
    Feng, Xiaoning
    2012 8TH INTERNATIONAL CONFERENCE ON COMPUTING AND NETWORKING TECHNOLOGY (ICCNT, INC, ICCIS AND ICMIC), 2012, : 153 - 158
  • [29] Pattern graph-based image retrieval system combining semantic and visual features
    Allani, Olfa
    Zghal, Hajer Baazaoui
    Mellouli, Nedra
    Akdag, Herman
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (19) : 20287 - 20316
  • [30] Graph-based discriminative features learning for fine-grained image retrieval
    Sun, Han
    Lang, Wenxi
    Xu, Can
    Liu, Ningzhong
    Zhou, Huiyu
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 110