Unstructured Road Vanishing Point Detection Using Convolutional Neural Networks and Heatmap Regression

被引:21
|
作者
Liu, Yin-Bo [1 ]
Zeng, Ming [1 ]
Meng, Qing-Hao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Inst Robot & Autonomous Syst, Tianjin Key Lab Proc Measurement & Control, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Heatmap regression; high-resolution representation network (HRNet); unstructured road; vanishing point (VP) detection; YOLO; LANE DETECTION;
D O I
10.1109/TIM.2020.3019863
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unstructured road vanishing point (VP) detection is a challenging problem, especially in the field of autonomous driving. In this article, we proposed a novel solution combining the convolutional neural network (CNN) and heatmap regression to detect unstructured road VP. The proposed algorithm first adopted a lightweight backbone, i.e., depthwise convolution-modified HRNet, to extract hierarchical features of the unstructured road image. Then, three advanced strategies, i.e., multiscale supervised learning, heatmap superresolution, and coordinate regression techniques were utilized to carry out fast and high-precision unstructured road VP detection. The empirical results on Kong's data set showed that our proposed approach had the highest detection accuracy in real-time compared with the state-of-the-art methods under various conditions, and achieved the highest speed of 33 fps.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Fully Convolutional Neural Networks for Road Detection with Multiple Cues Integration
    Han, Xiaofeng
    Lu, Jianfeng
    Zhao, Chunxia
    Li, Hongdong
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 4608 - 4613
  • [42] Heatmap Regression for Lesion Detection Using Pointwise Annotations
    Myers-Colet, Chelsea
    Schroeter, Julien
    Arnold, Douglas L.
    Arbel, Tal
    MEDICAL IMAGE LEARNING WITH LIMITED AND NOISY DATA (MILLAND 2022), 2022, 13559 : 3 - 12
  • [43] Convolutional Neural Networks for Road Detection: An Unsupervised Domain Adaptation Approach
    Collegio, Gustavo Rota
    Dal Poz, Aluir Porfirio
    Guimaraes Filho, Antonio Gaudencio
    Habib, Ayman
    MID-TERM SYMPOSIUM THE ROLE OF PHOTOGRAMMETRY FOR A SUSTAINABLE WORLD, VOL. 48-2, 2024, : 65 - 71
  • [44] Accurate and Robust Vanishing Point Detection Method in Unstructured Road Scenes (vol 94, pg 143, 2018)
    Han, Jiaming
    Yang, Zhong
    Hu, Guoxiong
    Zhang, Tianyi
    Song, Jiarong
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2019, 94 (01) : 159 - 160
  • [45] A Local Soft Voting Method for Texture-Based Vanishing Point Detection from Unstructured road images
    Bui, Trung Hieu
    Nobuyama, Eitaku
    2012 PROCEEDINGS OF SICE ANNUAL CONFERENCE (SICE), 2012, : 396 - 401
  • [46] Body Joints Regression Using Deep Convolutional Neural Networks
    Abobakr, Ahmed
    Hossny, Mohammed
    Nahavandi, Saeid
    2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 3281 - 3287
  • [47] Road Detection Using a New Method for Vanishing Point Detection Based on Hough Transform
    Binu, B.
    GLOBAL TRENDS IN COMPUTING AND COMMUNICATION SYSTEMS, PT 1, 2012, 269 : 583 - 587
  • [48] Nesti-Net: Normal Estimation for Unstructured 3D Point Clouds using Convolutional Neural Networks
    Ben-Shabat, Yizhak
    Lindenbaum, Michael
    Fischer, Anath
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10104 - 10112
  • [49] A regression approach to zebra crossing detection based on convolutional neural networks
    Wu, Xue-Hua
    Hu, Renjie
    Bao, Yu-Qing
    IET CYBER-SYSTEMS AND ROBOTICS, 2021, 3 (01) : 44 - 52
  • [50] ROAD CRACK DETECTION USING DEEP CONVOLUTIONAL NEURAL NETWORK
    Zhang, Lei
    Yang, Fan
    Zhang, Yimin Daniel
    Zhu, Ying Julie
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 3708 - 3712