Obstacle detection for intelligent robots based on the fusion of 2D lidar and depth camera

被引:1
|
作者
Fan, Bailin [1 ]
Zhao, Hang [1 ]
Meng, Lingbei [2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[2] Tech Univ Dresden, D-10623 Dresden, Free State Of S, Germany
关键词
2D lidar; depth camera; multi-sensor fusion; ROS; intelligent robot;
D O I
10.1504/IJHM.2024.135994
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
To address the limitations of traditional obstacle detection methods that rely on single sensors and cannot accurately detect and locate obstacles in complex environments, this paper proposes an obstacle detection method based on the fusion of 2D lidar and depth camera. The proposed method converts the data from the two sensors into lidar data in the same coordinate system for clustering analysis and obstacle identification. It uses Kalman filtering to estimate and predict the target state, significantly improving the range and accuracy of obstacle detection and providing more reliable obstacle information for intelligent robots. Experimental results show that the proposed method outperforms other commonly used methods in actual indoor scenes, demonstrating that the fusion of obstacle detection methods can effectively detect different types of obstacles and accurately measure and track their positions.
引用
收藏
页码:67 / 88
页数:23
相关论文
共 50 条
  • [1] FUZZY LOGIC BASED FUSION OF 2D LIDAR AND DEPTH CAMERA DATA FOR ROBUST PERCEPTION OF OBSTACLE DISTANCE
    Saksena, Harsh
    Anwar, Sohel
    [J]. PROCEEDINGS OF ASME 2022 INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, IMECE2022, VOL 5, 2022,
  • [2] Sensor Fusion of a Camera and 2D LIDAR for Lane Detection
    Yeniaydin, Yasin
    Schmidt, Klaus Werner
    [J]. 2019 27TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2019,
  • [3] Research on SLAM Algorithm of Mobile Robot Based on the Fusion of 2D LiDAR and Depth Camera
    Mu, Lili
    Yao, Pantao
    Zheng, Yuchen
    Chen, Kai
    Wang, Fangfang
    Qi, Nana
    [J]. IEEE ACCESS, 2020, 8 : 157628 - 157642
  • [4] The Obstacle Detection Method of UAV Based on 2D Lidar
    Zheng, Lanxiang
    Zhang, Ping
    Tan, Jia
    Li, Fang
    [J]. IEEE ACCESS, 2019, 7 : 163437 - 163448
  • [5] Obstacle detection based on depth fusion of lidar and radar in challenging conditions
    Xie, Guotao
    Zhang, Jing
    Tang, Junfeng
    Zhao, Hongfei
    Sun, Ning
    Hu, Manjiang
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2021, 48 (06): : 792 - 802
  • [6] Obstacle Detection of Intelligent Vehicle Based on Fusion of Lidar and Machine Vision
    Sun, Binbin
    Li, Wentao
    Liu, Huibin
    Yan, Jinghao
    Gao, Song
    Feng, Penghang
    [J]. ENGINEERING LETTERS, 2021, 29 (02) : 722 - 730
  • [7] Research on unmanned vehicle obstacle avoidance technology based on LIDAR and depth camera fusion
    Qiu H.
    Chen W.
    Ji A.
    Hu K.
    [J]. Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [8] UAV low-altitude obstacle detection based on the fusion of LiDAR and camera
    Ma Z.
    Yao W.
    Niu Y.
    Lin B.
    Liu T.
    [J]. Autonomous Intelligent Systems, 1 (1):
  • [9] Algorithm Research Based on 2D LiDAR-Binocular Camera Fusion
    Wang, Chuyue
    Wang, Meiling
    Zhan, Wenfeng
    Ye, Xiaodong
    [J]. 2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 297 - 300
  • [10] Camera and LiDAR Sensor Fusion Method for Object Estimation of Intelligent Robots
    Lee, Sun Ho
    Choi, Woo Young
    [J]. Journal of Institute of Control, Robotics and Systems, 2024, 30 (08) : 810 - 816