Real-time visual SLAM based YOLO-Fastest for dynamic scenes

被引:1
|
作者
Gong, Can [1 ,2 ]
Sun, Ying [1 ,3 ]
Zou, Chunlong [4 ]
Tao, Bo [1 ,2 ]
Huang, Li [5 ,6 ]
Fang, Zifan [7 ]
Tang, Dalai [8 ]
机构
[1] Wuhan Univ Sci & Technol, Minist Educ, Key Lab Met Equipment & Control Technol, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Res Ctr Biomimet Robot & Intelligent Measurement &, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] Hubei Univ Automot Technol, Coll Mech Engn, Shiyan 442000, Peoples R China
[5] Wuhan Univ Sci & Technol, Coll Comp Sci & Technol, Wuhan 430081, Peoples R China
[6] Wuhan Univ Sci & Technol, Hubei Prov Key Lab Intelligent Informat Proc & Rea, Wuhan 430081, Peoples R China
[7] China Three Gorges Univ, Hubei Key Lab Hydroelect Machinery Design Maintena, Yichang 443002, Peoples R China
[8] Inner Mongolia Univ Finance & Econ, Sch Comp Informat Management, Hohhot 010051, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic SLAM; geometric constraint; depth residual; dynamic object mask segmentation; ROBUST;
D O I
10.1088/1361-6501/ad2669
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Within the realm of autonomous robotic navigation, simultaneous localization and mapping (SLAM) serves as a critical perception technology, drawing heightened attention in contemporary research. The traditional SLAM systems perform well in static environments, but in the real physical world, dynamic objects can destroy the static geometric constraints of the SLAM system, further limiting its practical application in the real world. In this paper, a robust dynamic RGB-D SLAM system is proposed to expand the number of static points in the scene by combining with YOLO-Fastest to ensure the effectiveness of the geometric constraints model construction, and then based on that, a new thresholding model is designed to differentiate the dynamic features in the objection bounding box, which takes advantage of the double polyline constraints and the residuals after reprojection to filter the dynamic feature points. In addition, two Gaussian models are constructed to segment the moving objects in the bounding box in the depth image to achieve the effect similar to the instance segmentation under the premise of ensuring the computational speed. In this paper, experiments are conducted on dynamic sequences provided by the TUM dataset to evaluate the performance of the proposed method, and the results show that the root mean squared error metric of the absolute trajectory error of the algorithm of this paper has at least 80% improvement compared to ORB-SLAM2. Higher robustness in dynamic environments with both high and low dynamic sequences compared to DS-SLAM and Dynaslam, and can effectively provide intelligent localization and navigation for mobile robots.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] VSLAM Optimization Method in Dynamic Scenes Based on YOLO-Fastest
    Song, Zijing
    Su, Weihua
    Chen, Haiyong
    Feng, Mianshi
    Peng, Jiahe
    Zhang, Aifang
    [J]. ELECTRONICS, 2023, 12 (17)
  • [2] UDS-SLAM: real-time robust visual SLAM based on semantic segmentation in dynamic scenes
    Liu, Jun
    Dong, Junyuan
    Hu, Mingming
    Lu, Xu
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024, 51 (02): : 206 - 218
  • [3] FFD-SLAM: A Real-Time Visual SLAM Toward Dynamic Scenes with Semantic and Optical Flow Information
    Zhang, Hao
    Wang, Yu
    Zhong, Tianjie
    Dong, Fangyan
    Chen, Kewei
    [J]. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2024, 28 (03) : 586 - 594
  • [4] YLS-SLAM: a real-time dynamic visual SLAM based on semantic segmentation
    Feng, Dan
    Yin, Zhenyu
    Wang, Xiaohui
    Zhang, Feiqing
    Wang, Zisong
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024,
  • [5] A Real-Time Dynamic Object Segmentation Framework for SLAM System in Dynamic Scenes
    Chang, Jianfang
    Dong, Na
    Li, Donghui
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [6] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [7] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [8] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [9] SIG-SLAM: Semantic Information-Guided Real-Time SLAM for Dynamic Scenes
    Li, Xingyuan
    Guan, Shengxiao
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1539 - 1544
  • [10] Research on Real-Time Visual SLAM Method Based on 3D Multi-Object Tracking in Dynamic Scenes
    Chen, Jiqing
    Che, Yuxiang
    Tian, Xiaoqiang
    Lan, Fengchong
    Zhou, Yunjiao
    [J]. Qiche Gongcheng/Automotive Engineering, 2024, 46 (05): : 776 - 783