Road detection based on the fusion of Lidar and image data

被引:35
|
作者
Han, Xiaofeng [1 ]
Wang, Huan [1 ]
Lu, Jianfeng [1 ]
Zhao, Chunxia [1 ]
机构
[1] Nanjing Univ Sci & Technol, Inst Intelligent Robot, 200 Xiaolingwei St, Nanjing 210094, Jiangsu, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Road detection; conditional random field; multi-sensor fusion; robotic vision; autonomous vehicles; TEXTURE;
D O I
10.1177/1729881417738102
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this article, we propose a road detection method based on the fusion of Lidar and image data under the framework of conditional random field. Firstly, Lidar point clouds are projected into the monocular images by cross calibration to get the sparse height images, and then we get high-resolution height images via a joint bilateral filter. Then, for all the training image pixels which have corresponding Lidar points, we extract their features from color image and Lidar point clouds, respectively, and use these features together with the location features to train an Adaboost classifier. After that, all the testing pixels are classified into road or non-road under a conditional random field framework. In this conditional random field framework, we use the scores computed from the Adaboost classifier as the unary potential and take the height value of each pixel and its color information into consideration together for the pairwise potential. Finally, experimental tests have been carried out on the KITTI Road data set, and the results show that our method performs well on this data set.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] VANISHING POINT DETECTION BASED ON THE FUSION OF LIDAR AND IMAGE DATA
    Kloukiniotis, Andreas
    Moustakas, Konstantinos
    2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 688 - 692
  • [2] Road perception and road line detection based on fusion of LiDAR and camera
    Fan Yimei
    Yu Xin
    Xu Nana
    Chen Jinqi
    Chen Tianding
    SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [3] Road segmentation with image-LiDAR data fusion in deep neural network
    Liu, Huafeng
    Yao, Yazhou
    Sun, Zeren
    Li, Xiangrui
    Jia, Ke
    Tang, Zhenming
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (47-48) : 35503 - 35518
  • [4] Road segmentation with image-LiDAR data fusion in deep neural network
    Huafeng Liu
    Yazhou Yao
    Zeren Sun
    Xiangrui Li
    Ke Jia
    Zhenming Tang
    Multimedia Tools and Applications, 2020, 79 : 35503 - 35518
  • [5] Fusion of LiDAR and Camera by Scanning in LiDAR Imagery and Image-Guided Diffusion for Urban Road Detection
    Zhang, Yigong
    Gu, Shuo
    Yang, Jian
    Alvarez, Jose M.
    Kong, Hui
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 579 - 584
  • [6] Road Detection through CRF based LiDAR-Camera Fusion
    Gu, Shuo
    Zhang, Yigong
    Tang, Jinhui
    Yang, Jiang
    Kong, Hui
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 3832 - 3838
  • [7] Automatic Road Extraction from LIDAR Data based on Classifier Fusion
    Samadzadegan, Farhad
    Hahn, Michael
    Bigdeli, Behnaz
    2009 JOINT URBAN REMOTE SENSING EVENT, VOLS 1-3, 2009, : 1605 - +
  • [8] U-Net-based RGB and LiDAR image fusion for road segmentation
    Candan, Arda Taha
    Kalkan, Habil
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (06) : 2837 - 2843
  • [9] U-Net-based RGB and LiDAR image fusion for road segmentation
    Arda Taha Candan
    Habil Kalkan
    Signal, Image and Video Processing, 2023, 17 : 2837 - 2843
  • [10] Road Sign Detection and Localization Based on Camera and Lidar Data
    Buyval, Alexander
    Gabdullin, Aidar
    Lyubimov, Maxim
    ELEVENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2018), 2019, 11041