Fast Road Detection by CNN-Based Camera-Lidar Fusion and Spherical Coordinate Transformation

被引:21
|
作者
Lee, Jae-Seol [1 ]
Park, Tae-Hyoung [2 ]
机构
[1] Chungbuk Natl Univ, Dept Control & Robot Engn, Cheongju 28644, South Korea
[2] Chungbuk Natl Univ, Sch Elect Engn, Cheongju 28644, South Korea
关键词
Laser radar; Cameras; Sensor fusion; Autonomous vehicles; Image segmentation; Convolutional neural networks; Road detection; lidar and camera fusion; segmentation; convolution neural network; spherical coordinate transformation; autonomous vehicles; SEGMENTATION;
D O I
10.1109/TITS.2020.2988302
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
We propose a new camera-lidar fusion method for road detection where the spherical coordinate transformation is introduced to decrease the gap between the point cloud of 3D lidar data. The camera's color data and the 3D lidar's height data are transformed into the same spherical coordinate, and then input to the convolution neural network for segmentation. Faster segmentation is possible due to the reduced size of input data. To increase the detection accuracy, this modified SegNet expands the receptive field of the network. Using the KITTI dataset, we present the experimental results to show the usefulness of the proposed method.
引用
收藏
页码:5802 / 5810
页数:9
相关论文
共 50 条
  • [21] Robust Feature-Based Camera-LiDAR Fusion for Global Localization of a Mobile Robot
    Salam, Yasir
    Li, Yinbei
    Yang, Jiaqiang
    Fan, Wei
    CONTROL ENGINEERING AND APPLIED INFORMATICS, 2024, 26 (04): : 40 - 49
  • [22] Probabilistic multi-modal depth estimation based on camera-LiDAR sensor fusion
    Obando-Ceron, Johan S.
    Romero-Cano, Victor
    Monteiro, Sildomar
    MACHINE VISION AND APPLICATIONS, 2023, 34 (05)
  • [23] High-Accuracy Lane Geodetic Coordinates Extraction Based on Camera-Lidar Fusion
    Peng, Cheng-Wei
    Hsu, Chen-Chien
    Wang, Wei-Yen
    2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [24] Free Space Detection Using Camera-LiDAR Fusion in a Bird's Eye View Plane
    Yu, Byeongjun
    Lee, Dongkyu
    Lee, Jae-Seol
    Kee, Seok-Cheol
    SENSORS, 2021, 21 (22)
  • [25] Filter Fusion: Camera-LiDAR Filter Fusion for 3-D Object Detection With a Robust Fused Head
    Xu, Yaming
    Li, Boliang
    Wang, Yan
    Cui, Yihan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [26] Boosting CNN-Based Pedestrian Detection via 3D LiDAR Fusion in Autonomous Driving
    Dou, Jian
    Fang, Jianwu
    Li, Tao
    Xue, Jianru
    IMAGE AND GRAPHICS (ICIG 2017), PT II, 2017, 10667 : 3 - 13
  • [27] Vehicle Detection Based on LiDAR and Camera Fusion
    Zhang, Feihu
    Clarke, Daniel
    Knoll, Alois
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2014, : 1620 - 1625
  • [28] Reinforcement Learning and Genetic Algorithm-Based Network Module for Camera-LiDAR Detection
    Kim, Taek-Lim
    Park, Tae-Hyoung
    REMOTE SENSING, 2024, 16 (13)
  • [29] MFSA-Net: Semantic Segmentation With Camera-LiDAR Cross-Attention Fusion Based on Fast Neighbor Feature Aggregation
    Duan, Yijian
    Meng, Liwen
    Meng, Yanmei
    Zhu, Jihong
    Zhang, Jiacheng
    Zhang, Jinlai
    Liu, Xin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 19627 - 19639
  • [30] CNN-based UGS method using Cartesian-to-polar coordinate transformation
    Kim, B. -S.
    Sun, J. -Y.
    Kim, S. -W.
    Kang, M. -C.
    Ko, S. -J.
    ELECTRONICS LETTERS, 2018, 54 (23) : 1321 - +