Dynamic visual simultaneous localization and mapping based on semantic segmentation module

被引:7
|
作者
Jin, Jing [1 ,2 ,3 ]
Jiang, Xufeng [1 ,2 ,3 ]
Yu, Chenhui [1 ]
Zhao, Lingna [4 ]
Tang, Zhen [4 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Key Lab Ind Safety & Emergency Technol, Hefei 230009, Peoples R China
[3] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230009, Peoples R China
[4] Anhui Water Conservancy Tech Coll, Sch Mechatron Engn, Hefei 231603, Peoples R China
关键词
Semantic SLAM; Dynamic scenes; Epipolar constraints; Point cloud map; MONOCULAR SLAM; ENVIRONMENTS; TRACKING;
D O I
10.1007/s10489-023-04531-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous localization and mapping (SLAM) is a key technique for mobile robotics. Moving objects can vastly impair the performance of a visual SLAM system. To deal with the problem, a new semantic visual SLAM system for indoor environments is proposed. Our system adds a semantic segmentation network and geometric model to detect and remove dynamic feature points on moving objects. Moreover, a 3D point cloud map with semantic information is created using semantic labels and depth images. We evaluate our method on the TUM RGB-D dataset and real-world environments. The evaluation metrics used are absolute trajectory error and relative position error. Experimental results show our method improves the accuracy in dynamic scenes compared to ORB-SLAM3 and other advanced methods.
引用
收藏
页码:19418 / 19432
页数:15
相关论文
共 50 条
  • [41] Increasing the localization accuracy of visual SLAM with semantic segmentation and motion consistency detection in dynamic scenes
    Shen, Dong
    Fang, Haoyu
    Li, Qiang
    Liu, Jiale
    Guo, Sheng
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (05) : 7501 - 7512
  • [42] Earth-based Simultaneous Localization and Mapping for Drones in Dynamic Environments
    Manuel Simas
    Bruno J. Guerreiro
    Pedro Batista
    Journal of Intelligent & Robotic Systems, 2022, 104
  • [43] Dynamic simultaneous localization and mapping based on object tracking in occluded environment
    Ding, Weili
    Pei, Ziqi
    Yang, Tao
    Chen, Taiyu
    ROBOTICA, 2024, 42 (07) : 2209 - 2225
  • [44] Earth-based Simultaneous Localization and Mapping for Drones in Dynamic Environments
    Simas, Manuel
    Guerreiro, Bruno J.
    Batista, Pedro
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 104 (04)
  • [45] Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments
    Yang, Shiqiang
    Zhao, Cheng
    Wu, Zhengkun
    Wang, Yan
    Wang, Guodong
    Li, Dexin
    IEEE ACCESS, 2022, 10 : 69636 - 69649
  • [46] Online simultaneous localization and mapping in dynamic environments
    Wolf, D
    Sukhatme, GS
    2004 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1- 5, PROCEEDINGS, 2004, : 1301 - 1307
  • [47] Visual SLAM technology based on weakly supervised semantic segmentation in dynamic environment
    Liu, Jianxin
    Zeng, Menglan
    Wang, Yuchao
    Liu, Wei
    INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2020, 2020, 11574
  • [48] AN IMPROVED SIMULTANEOUS LOCALIZATION AND MAPPING FOR DYNAMIC ENVIRONMENTS
    Badalkhani, S.
    Havangi, R.
    Farshad, M.
    INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2021, 36 (06): : 374 - 382
  • [49] Semantic Segmentation in the Task of Long-Term Visual Localization
    Bures, Lukas
    Mueller, Ludek
    INTERACTIVE COLLABORATIVE ROBOTICS (ICR 2021), 2021, 12998 : 27 - 39
  • [50] Toward Semantic Loop Closure in Simultaneous Localization and Mapping Systems
    Yang, Che-Yu
    Zhang, Yu-Cheng
    Chen, Yu-Hsiu
    Huang, Chih-Wei
    CURRENT DEVELOPMENTS IN LENS DESIGN AND OPTICAL ENGINEERING XIX, 2018, 10745