Dynamic visual simultaneous localization and mapping based on semantic segmentation module

被引:7
|
作者
Jin, Jing [1 ,2 ,3 ]
Jiang, Xufeng [1 ,2 ,3 ]
Yu, Chenhui [1 ]
Zhao, Lingna [4 ]
Tang, Zhen [4 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Key Lab Ind Safety & Emergency Technol, Hefei 230009, Peoples R China
[3] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230009, Peoples R China
[4] Anhui Water Conservancy Tech Coll, Sch Mechatron Engn, Hefei 231603, Peoples R China
关键词
Semantic SLAM; Dynamic scenes; Epipolar constraints; Point cloud map; MONOCULAR SLAM; ENVIRONMENTS; TRACKING;
D O I
10.1007/s10489-023-04531-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous localization and mapping (SLAM) is a key technique for mobile robotics. Moving objects can vastly impair the performance of a visual SLAM system. To deal with the problem, a new semantic visual SLAM system for indoor environments is proposed. Our system adds a semantic segmentation network and geometric model to detect and remove dynamic feature points on moving objects. Moreover, a 3D point cloud map with semantic information is created using semantic labels and depth images. We evaluate our method on the TUM RGB-D dataset and real-world environments. The evaluation metrics used are absolute trajectory error and relative position error. Experimental results show our method improves the accuracy in dynamic scenes compared to ORB-SLAM3 and other advanced methods.
引用
收藏
页码:19418 / 19432
页数:15
相关论文
共 50 条
  • [31] Map segmentation for simultaneous localization and mapping in ruins
    Wang, Nan
    Ma, Shugen
    Li, Bin
    Wang, Minghui
    Zhao, Mingyang
    ADVANCED ROBOTICS, 2016, 30 (01) : 1 - 14
  • [32] A Lightweight Visual Simultaneous Localization and Mapping Method with a High Precision in Dynamic Scenes
    Zhang, Qi
    Yu, Wentao
    Liu, Weirong
    Xu, Hao
    He, Yuan
    SENSORS, 2023, 23 (22)
  • [33] Real-Time Artificial Intelligence Based Visual Simultaneous Localization and Mapping in Dynamic Environments - a Review
    Aasim, Wan Faris Aizat Wan
    Okasha, Mohamed
    Faris, Waleed Fekry
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 105 (01)
  • [34] Real-Time Artificial Intelligence Based Visual Simultaneous Localization and Mapping in Dynamic Environments – a Review
    Wan Faris Aizat Wan Aasim
    Mohamed Okasha
    Waleed Fekry Faris
    Journal of Intelligent & Robotic Systems, 2022, 105
  • [35] GAN based simultaneous localization and mapping framework in dynamic environment
    Sun, Bo
    Gao, Song
    Zi, Hongmei
    Wue, Qiong
    JOURNAL OF KING SAUD UNIVERSITY SCIENCE, 2022, 34 (08)
  • [36] Visual Simultaneous Localization and Mapping (SLAM) Based on Blurred Image Detection
    Huaiyuan Yu
    Haijiang Zhu
    Fengrong Huang
    Journal of Intelligent & Robotic Systems, 2021, 103
  • [37] A Review of Visual-LiDAR Fusion based Simultaneous Localization and Mapping
    Debeunne, Cesar
    Vivet, Damien
    SENSORS, 2020, 20 (07)
  • [38] A Navigation Aid for Blind People Based on Visual Simultaneous Localization and Mapping
    Chen Cing-Han
    Wang Chien-Chun
    Lin Sian-Fong
    2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TAIWAN), 2020,
  • [39] Research progress of visual simultaneous localization and mapping based on deep learning
    Zhang Y.
    Wu Y.
    Chen H.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (07): : 214 - 241
  • [40] Visual Simultaneous Localization and Mapping (SLAM) Based on Blurred Image Detection
    Yu, Huaiyuan
    Zhu, Haijiang
    Huang, Fengrong
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 103 (01)