Integrating Human Visual Perception in Scene Understanding by Saliency Visual SLAM

被引:0
|
作者
Kataoka, Naoki [1 ]
Siritanawan, Prarinya [1 ]
Kotani, Kazunori [1 ]
机构
[1] JAIST, Sch Informat Sci, Nomi, Ishikawa, Japan
关键词
Saliency; VSLAM; Autonomous Exploration; Mobile Robots;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we propose Salient SLAM, a real-time 3D map generation with saliency information based on human visual characteristics. We used a Fine-Grained technique to generate a saliency map on the spatial domain. Then, we integrated this saliency map to a real-time feature-based Visual SLAM technique. As a result, we can obtain a three-dimensional feature map with saliency information and enable the ability to use this saliency information in robots' autonomous and exploration. Finally, the Salient SLAM map point is leveled into four levels where the higher the level, the higher the score of saliencies in the environment. In the experiments, we investigated and analyzed the characteristics of each saliency level in global feature maps according to the type of objects and visual patterns.
引用
收藏
页码:916 / 923
页数:8
相关论文
共 50 条
  • [31] Understanding the Influence of Random Impulse Noise on Visual SLAM
    Zhang, Nan
    Peng, Zhihong
    Quan, Wei
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6515 - 6520
  • [32] Neuromorphic visual scene understanding with resonator networks
    Renner, Alpha
    Supic, Lazar
    Danielescu, Andreea
    Indiveri, Giacomo
    Olshausen, Bruno A.
    Sandamirskaya, Yulia
    Sommer, Friedrich T.
    Frady, E. Paxon
    NATURE MACHINE INTELLIGENCE, 2024, : 641 - 652
  • [33] FC-vSLAM: Integrating Feature Credibility in Visual SLAM
    Xie, Shuai
    Ma, Wei
    Wang, Qiuyuan
    Xu, Ruchang
    Zha, Hongbin
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 959 - 967
  • [34] A model of saliency-based visual attention for rapid scene analysis
    Itti, L
    Koch, C
    Niebur, E
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1998, 20 (11) : 1254 - 1259
  • [35] Integrating vestibular and visual cues for verticality perception
    Schoenmaekers, Catho
    Wuyts, Floris L.
    Ferre, Elisa R.
    EXPERIMENTAL BRAIN RESEARCH, 2025, 243 (02)
  • [36] Effect of Acoustic Scene Complexity and Visual Scene Representation on Auditory Perception in Virtual Audio-Visual Environments
    Fichna, Stefan
    Biberger, Thomas
    Seeber, Bernhard U.
    Ewert, Stephan D.
    2021 IMMERSIVE AND 3D AUDIO: FROM ARCHITECTURE TO AUTOMOTIVE (I3DA), 2021,
  • [37] Audio-visual saliency prediction with multisensory perception and integration
    Xie, Jiawei
    Liu, Zhi
    Li, Gongyang
    Song, Yingjie
    IMAGE AND VISION COMPUTING, 2024, 143
  • [38] The role of the human primary visual cortex in visual perception and visual search
    Weerda, R.
    Arndt, P.
    Colonius, H.
    Greenlee, M. W.
    PERCEPTION, 2006, 35 : 103 - 104
  • [39] On Combining Visual SLAM and Visual Odometry
    Williams, Brian
    Reid, Ian
    2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 3494 - 3500
  • [40] Eye Movements and Visual Encoding During Scene Perception
    Rayner, Keith
    Smith, Tim J.
    Malcolm, George L.
    Henderson, John M.
    PSYCHOLOGICAL SCIENCE, 2009, 20 (01) : 6 - 10