Lane line detection based on the codec structure of the attention mechanism

被引:5
|
作者
Zhao, Qinghua [1 ]
Peng, Qi [1 ]
Zhuang, Yiqi [1 ]
机构
[1] Xidian Univ, Sch Microelect, Xian, Peoples R China
基金
中国国家自然科学基金;
关键词
Lane detection; Autonomous driving; Channel attention; Spatial attention; SYSTEM;
D O I
10.1007/s11554-022-01217-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For self-driving cars and advanced driver assistance systems, lane detection is imperative. On the one hand, numerous current lane line detection algorithms perform dense pixel-by-pixel prediction followed by complex post-processing. On the other hand, as lane lines only account for a small part of the whole image, there are only very subtle and sparse signals, and information is lost during long-distance transmission. Therefore, it is difficult for an ordinary convolutional neural network to resolve challenging scenes, such as severe occlusion, congested roads, and poor lighting conditions. To address these issues, in this study, we propose an encoder-decoder architecture based on an attention mechanism. The encoder module is employed to initially extract the lane line features. We propose a spatial recurrent feature-shift aggregator module to further enrich the lane line features, which transmits information from four directions (up, down, left, and right). In addition, this module contains the spatial attention feature that focuses on useful information for lane line detection and reduces redundant computations. In particular, to reduce the occurrence of incorrect predictions and the need for post-processing, we add channel attention between the encoding and decoding. It processes encoding and decoding to obtain multidimensional attention information, respectively. Our method achieved novel results on two popular lane detection benchmarks (CULane F1-measure 76.2, TuSimple accuracy 96.85%), which can reach 48 frames per second and meet the real-time requirements of autonomous driving.
引用
收藏
页码:715 / 726
页数:12
相关论文
共 50 条
  • [1] Lane line detection based on the codec structure of the attention mechanism
    Qinghua Zhao
    Qi Peng
    Yiqi Zhuang
    Journal of Real-Time Image Processing, 2022, 19 : 715 - 726
  • [2] Lane detection based on dual attention mechanism
    Ren, Feng-lei
    Zhou, Hai-bo
    Yang, Lu
    He, Xin
    CHINESE OPTICS, 2023, 16 (03) : 645 - 653
  • [3] Lightweight lane line detection based on learnable cluster segmentation with self-attention mechanism
    Yang, Qin
    Ma, Yahong
    Li, Linsen
    Su, Chang
    Gao, Yujie
    Tao, Jiaxin
    Huang, Zhentao
    Jiang, Rui
    IET INTELLIGENT TRANSPORT SYSTEMS, 2023, 17 (03) : 518 - 529
  • [4] EAFMNet: An Efficient Attention Fusion Mechanism for Lane Detection
    Ran, Hao
    Yin, Yunfei
    Huang, Faliang
    Bao, Xianjian
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3756 - 3761
  • [5] LDNet: structure-focused lane detection based on line deformation
    Zhang, Jun
    Wang, Xingbin
    Guo, Binglei
    High Technology Letters, 2022, 28 (03) : 307 - 316
  • [6] LDNet:structure-focused lane detection based on line deformation
    张军
    WANG Xingbin
    GUO Binglei
    HighTechnologyLetters, 2022, 28 (03) : 307 - 316
  • [7] AC-UNet: lane line detection based on U-Net network fusion attention mechanism and cross convolution
    Fan, Chao
    Wang, Xiao
    Qiu, Qingying
    Chen, Zhixiang
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024, 238 (14) : 4394 - 4408
  • [8] A lane detection network based on IBN and attention
    Wenhui Li
    Feng Qu
    Jialun Liu
    Fengdong Sun
    Ying Wang
    Multimedia Tools and Applications, 2020, 79 : 16473 - 16486
  • [9] A lane detection network based on IBN and attention
    Li, Wenhui
    Qu, Feng
    Liu, Jialun
    Sun, Fengdong
    Wang, Ying
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (23-24) : 16473 - 16486
  • [10] An Improved Dual-Subnet Lane Line Detection Model with a Channel Attention Mechanism for Complex Environments
    Bi, Zhong-qin
    Deng, Kai-an
    Zhong, Wei
    Shan, Mei-jing
    COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING, COLLABORATECOM 2022, PT II, 2022, 461 : 496 - 515