DYS-SLAM: A real-time RGBD SLAM combined with optical flow and semantic information in a dynamic environment

被引:2
|
作者
Fang, Yuhua [1 ]
Xie, Zhijun [1 ]
Chen, Kewei [2 ]
Huang, Guangyan [3 ]
Zarei, Roozbeh [3 ]
Xie, Yuntao [4 ]
机构
[1] Ningbo Univ, Sch Fac Elect Engn & Comp Sci, Ningbo, Peoples R China
[2] Ningbo Univ, Sch Fac Mech Engn & Mech, Ningbo, Peoples R China
[3] Deakin Univ, Sch Informat Technol, Melbourne, Vic, Australia
[4] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Visual SLAM; object detection; dynamic environment; deep learning for visual perception; SIMULTANEOUS LOCALIZATION;
D O I
10.3233/JIFS-234235
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional Simultaneous Localization and Mapping application in dynamic situations is constrained by static assumptions. However, the majority of well-known dynamic SLAM systems use deep learning to identify dynamic objects, which creates the issue of trade-offs between accuracy and real-time. To tackle this issue, this work suggests a unique dynamic semantics method(DYS-SLAM) for semantic simultaneous localization and mapping that strikes a trade-off between high accuracy and high real-time performance. We propose M-LK, an enhanced Lucas-Kanade(LK) optical flow method. This technique keeps the continuous motion and greyscale consistency assumptions from the original method while switching out the spatial consistency assumption for a motion consistency assumption, reducing sensitivity to image gradients to identify dynamic feature points and regions efficiently. In order to increase segmentation accuracy while maintaining real-time performance, we develop a segmentation refinement scheme that projects 3D point cloud segmentation results into 2D object detection zones. A dense semantic octree graph is built in the interim to expedite the high-level process. Compared to the four equivalent dynamic SLAM approaches, experiments on the publicly available TUM RGB-D dataset demonstrate that the DYS-SLAM method offers competitive localization accuracy and satisfactory real-time performance in both high and low-dynamic scenarios.
引用
收藏
页码:10349 / 10367
页数:19
相关论文
共 50 条
  • [1] FFD-SLAM: A Real-Time Visual SLAM Toward Dynamic Scenes with Semantic and Optical Flow Information
    Zhang, Hao
    Wang, Yu
    Zhong, Tianjie
    Dong, Fangyan
    Chen, Kewei
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2024, 28 (03) : 586 - 594
  • [2] A real-time visual SLAM based on semantic information and geometric information in dynamic environment
    Sun, Hongli
    Fan, Qingwu
    Zhang, Huiqing
    Liu, Jiajing
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (05)
  • [3] Real-time RGBD SLAM System
    Czuprynski, Blazej
    Strupczewski, Adam
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2015, 2015, 9662
  • [4] SCE-SLAM: a real-time semantic RGBD SLAM system in dynamic scenes based on spatial coordinate error
    Song, Shiyu
    Chen, Ji
    Zhong, Yujiang
    Zhang, Wei
    Hou, Wenbo
    Zhang, Liumingyuan
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (12)
  • [5] Semantic RGBD-SLAM in dynamic scene based on optical flow
    Liu Y.
    He L.
    Yuan L.
    Qi J.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2022, 43 (12): : 139 - 148
  • [6] DGS-SLAM: A Fast and Robust RGBD SLAM in Dynamic Environments Combined by Geometric and Semantic Information
    Yan, Li
    Hu, Xiao
    Zhao, Leyang
    Chen, Yu
    Wei, Pengcheng
    Xie, Hong
    REMOTE SENSING, 2022, 14 (03)
  • [7] SIG-SLAM: Semantic Information-Guided Real-Time SLAM for Dynamic Scenes
    Li, Xingyuan
    Guan, Shengxiao
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1539 - 1544
  • [8] RDMO-SLAM: Real-Time Visual SLAM for Dynamic Environments Using Semantic Label Prediction With Optical Flow
    Liu, Yubao
    Miura, Jun
    IEEE ACCESS, 2021, 9 : 106981 - 106997
  • [9] MVS-SLAM: Enhanced multiview geometry for improved semantic RGBD SLAM in dynamic environment
    Ul Islam, Qamar
    Ibrahim, Haidi
    Chin, Pan Kok
    Lim, Kevin
    Abdullah, Mohd Zaid
    JOURNAL OF FIELD ROBOTICS, 2024, 41 (01) : 109 - 130
  • [10] VIS-SLAM: A Real-Time Dynamic SLAM Algorithm Based on the Fusion of Visual, Inertial, and Semantic Information
    Wang, Yinglong
    Liu, Xiaoxiong
    Zhao, Minkun
    Xu, Xinlong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2024, 13 (05)