Attentional Landmarks and Active Gaze Control for Visual SLAM

被引:92
|
作者
Frintrop, Simone [1 ]
Jensfelt, Patric [2 ]
机构
[1] Univ Bonn, Inst Comp Sci 3, D-53117 Bonn, Germany
[2] Royal Inst Technol, CAS, S-10044 Stockholm, Sweden
基金
瑞典研究理事会;
关键词
Active camera control; landmark selection; mobile robotics; saliency; visual attention; visual simultaneous localization and mapping (SLAM);
D O I
10.1109/TRO.2008.2004977
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This paper is centered around landmark detection, tracking, and matching for visual simultaneous localization and mapping using a monocular vision system with active gaze control. We present a system that specializes in creating and maintaining a sparse set of landmarks based on a biologically motivated feature-selection strategy. A visual attention system detects salient features that are highly discriminative and ideal candidates for visual landmarks that are easy to redetect. Features are tracked over several frames to determine stable landmarks and to estimate their 3-D position in the environment. Matching of current landmarks to database entries enables loop closing. Active gaze control allows us to overcome some of the limitations of using a monocular vision system with a relatively small field of view. It supports 1) the tracking of landmarks that enable a better pose estimation, 2) the exploration of regions without landmarks to obtain a better distribution of landmarks in the environment, and 3) the active redetection of landmarks to enable loop closing in situations in which a fixed camera fails to close the loop. Several real-world experiments show that accurate pose estimation is obtained with the presented system and that active camera control outperforms the passive approach.
引用
收藏
页码:1054 / 1065
页数:12
相关论文
共 50 条
  • [1] Active gaze control for attentional visual SLAM
    Frintrop, Simone
    Jensfelt, Patric
    2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 3690 - +
  • [2] Gaze Control for Active Visual SLAM via Panoramic Cost Map
    Xuan, Yuwen
    Zhang, Hui
    Yan, Fengjun
    Chen, Long
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (02): : 1813 - 1825
  • [3] Attentional landmark selection for visual SLAM
    Frintrop, Simone
    Jensfelt, Patric
    Christensen, Henrik I.
    2006 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-12, 2006, : 2582 - +
  • [4] Visual attention and gaze control for an active vision system
    Mertsching, B
    Bollmann, M
    PROGRESS IN CONNECTIONIST-BASED INFORMATION SYSTEMS, VOLS 1 AND 2, 1998, : 76 - 79
  • [5] Visual EKF-SLAM from Heterogeneous Landmarks
    Othon Esparza-Jimenez, Jorge
    Devy, Michel
    Gordillo, Jose L.
    SENSORS, 2016, 16 (04)
  • [6] Visual robot localization and mapping based on attentional landmarks
    Frintrop, Simone
    KI 2007: Advances in Artificial Intelligence, Proceedings, 2007, 4667 : 456 - 459
  • [7] Effects of visual map complexity on the attentional processing of landmarks
    Keil, Julian
    Edler, Dennis
    Kuchinke, Lars
    Dickmann, Frank
    PLOS ONE, 2020, 15 (03):
  • [8] Attention-SLAM: A Visual Monocular SLAM Learning From Human Gaze
    Li, Jinquan
    Pei, Ling
    Zou, Danping
    Xia, Songpengcheng
    Wu, Qi
    Li, Tao
    Sun, Zhen
    Yu, Wenxian
    IEEE SENSORS JOURNAL, 2021, 21 (05) : 6408 - 6420
  • [9] Active gaze, visual look-ahead and locomotor control
    Wilkie, R. M.
    Wann, J. P.
    PERCEPTION, 2006, 35 : 146 - 147
  • [10] Mining DCNN Landmarks for Long-term Visual SLAM
    Taisho, Tsukamoto
    Kanji, Tanaka
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2016, : 570 - 576