YDD-SLAM: Indoor Dynamic Visual SLAM Fusing YOLOv5 with Depth Information

被引:4
|
作者
Cong, Peichao [1 ]
Liu, Junjie [1 ]
Li, Jiaxing [1 ]
Xiao, Yixuan [1 ]
Chen, Xilai [1 ]
Feng, Xinjie [1 ]
Zhang, Xin [1 ]
机构
[1] Guangxi Univ Sci & Technol, Sch Mech & Automot Engn, Liuzhou 545006, Peoples R China
关键词
dynamic VSLAM; ORB-SLAM3; YOLOv5; object classification; depth information fusion; ROBUST; ENVIRONMENTS; VERSATILE;
D O I
10.3390/s23239592
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Simultaneous location and mapping (SLAM) technology is key in robot autonomous navigation. Most visual SLAM (VSLAM) algorithms for dynamic environments cannot achieve sufficient positioning accuracy and real-time performance simultaneously. When the dynamic object proportion is too high, the VSLAM algorithm will collapse. To solve the above problems, this paper proposes an indoor dynamic VSLAM algorithm called YDD-SLAM based on ORB-SLAM3, which introduces the YOLOv5 object detection algorithm and integrates deep information. Firstly, the objects detected by YOLOv5 are divided into eight subcategories according to their motion characteristics and depth values. Secondly, the depth ranges of the dynamic object and potentially dynamic object in the moving state in the scene are calculated. Simultaneously, the depth value of the feature point in the detection box is compared with that of the feature point in the detection box to determine whether the point is a dynamic feature point; if it is, the dynamic feature point is eliminated. Further, multiple feature point optimization strategies were developed for VSLAM in dynamic environments. A public data set and an actual dynamic scenario were used for testing. The accuracy of the proposed algorithm was significantly improved compared to that of ORB-SLAM3. This work provides a theoretical foundation for the practical application of a dynamic VSLAM algorithm.
引用
收藏
页数:32
相关论文
共 50 条
  • [31] Deep learning-based visual slam for indoor dynamic scenes
    Xu, Zhendong
    Song, Yong
    Pang, Bao
    Xu, Qingyang
    Yuan, Xianfeng
    APPLIED INTELLIGENCE, 2025, 55 (06)
  • [32] DAM-SLAM: depth attention module in a semantic visual SLAM based on objects interaction for dynamic environments
    Beghdadi Ayman
    Mallem Malik
    Beji Lotfi
    Applied Intelligence, 2023, 53 : 25802 - 25815
  • [33] DAM-SLAM: depth attention module in a semantic visual SLAM based on objects interaction for dynamic environments
    Ayman, Beghdadi
    Malik, Mallem
    Lotfi, Beji
    APPLIED INTELLIGENCE, 2023, 53 (21) : 25802 - 25815
  • [34] Improved yolov5 algorithm combined with depth camera and embedded system for blind indoor visual assistance
    Zhang, Kaikai
    Wang, Yanyan
    Shi, Shengzhe
    Wang, Qingqing
    Wang, Chun
    Liu, Sheng
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [35] SLAM with visual plane: Extracting vertical plane by fusing stereo vision and ultrasonic sensor for indoor environment
    Ahn, Sunghwan
    Lee, Kyongmin
    Chung, Wan Kyun
    Oh, Sang-Rok
    PROCEEDINGS OF THE 2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-10, 2007, : 4787 - +
  • [36] Indoor Dynamic Scene Visual SLAM Based On Human Detection And Geometric Constraints
    He, Jiantao
    He, Li
    Zhu, Haifei
    Xiang, Chaoqun
    Guan, Yisheng
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1652 - 1657
  • [37] Highly Dynamic Visual SLAM Dense Map Construction Based on Indoor Environments
    Mei, Jianfeng
    Zuo, Tao
    Song, Dong
    IEEE ACCESS, 2024, 12 : 38717 - 38731
  • [38] Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments
    Yang, Shiqiang
    Zhao, Cheng
    Wu, Zhengkun
    Wang, Yan
    Wang, Guodong
    Li, Dexin
    IEEE ACCESS, 2022, 10 : 69636 - 69649
  • [39] SGD-SLAM: a visual SLAM system with a dynamic feature rejection strategy combining semantic and geometric information for dynamic environments
    Chen, Yuqian
    Lu, Tongwei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (02)
  • [40] 动态场景下基于YOLOv5和几何约束的视觉SLAM算法
    王鸿宇
    吴岳忠
    陈玲姣
    陈茜
    包装工程, 2024, 45 (03) : 208 - 217