LaneFormer: Real-Time Lane Exaction and Detection via Transformer

被引:3
|
作者
Yang, Yinyi [1 ]
Peng, Haiyong [1 ]
Li, Chuanchang [1 ]
Zhang, Weiwei [1 ]
Yang, Kelu [2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Mech & Automot Engn, Shanghai 201620, Peoples R China
[2] CRRC Nanjing Puzhen Co Ltd, Res & Dev Dept, Nanjing 210031, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 19期
基金
中国国家自然科学基金;
关键词
lane line detection; attention mechanism; transformer network; road structure; TRACKING;
D O I
10.3390/app12199722
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In intelligent driving, lane line detection is a basic but challenging task, especially in complex road conditions. The current detection algorithms based on convolutional neural networks perform well for simple scenes with plenty of light, and the lane lines are clean and unobstructed. Still, they do not perform well for complex scenes such as damaged, blocked, and lack-of-light scenes. In this article, we have exceeded the above restrictions and propose an attractive network: LaneFormer; We use an end-to-end network for up and down sampling three times each, then fuse them in their respective channels to extract the slender lane line structure. At the same time, a correction module is designed to adjust the dimensions of the extracted features using MLP, judging whether the feature is completely extracted through the loss function. Finally, we send the feature into the transformer network, detect the lane line points through the attention mechanism, and design a road and camera model to fit the identified lane line feature points. Our proposed method has been validated in the TuSimple benchmark test, showing the most advanced accuracy with the lightest model and fastest speed.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Real-Time Lane Marking Detection
    Filonenko, Alexander
    Hernandez, Danilo Caceres
    Kurnianggoro, Laksono
    Seo, Dongwook
    Jo, Kang-Hyun
    [J]. 2015 IEEE 2ND INTERNATIONAL CONFERENCE ON CYBERNETICS (CYBCONF), 2015, : 125 - 128
  • [2] A Real-Time Lane Detection and Tracking Algorithm
    Gao, Qi
    Feng, Yan
    Wang, Li
    [J]. PROCEEDINGS OF 2017 IEEE 2ND INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC), 2017, : 1230 - 1234
  • [3] Real-time lane detection for autonomous vehicle
    Jeong, SG
    Kim, CS
    Lee, DY
    Ha, SK
    Lee, DH
    Lee, MH
    Hashimoto, H
    [J]. ISIE 2001: IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS PROCEEDINGS, VOLS I-III, 2001, : 1466 - 1471
  • [4] Real-time lane detection for autonomous navigation
    Jeong, SG
    Kim, CS
    Yoon, KS
    Lee, JN
    Bae, JI
    Lee, MH
    [J]. 2001 IEEE INTELLIGENT TRANSPORTATION SYSTEMS - PROCEEDINGS, 2001, : 508 - 513
  • [5] Real-time Lane detection by using multiple cues
    Teng, Zhu
    Kim, Jeong-Hyun
    Kang, Dong-Joong
    [J]. INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2010), 2010, : 2334 - 2337
  • [6] Real-Time Lane Detection Based on Deep Learning
    Sun-Woo Baek
    Myeong-Jun Kim
    Upendra Suddamalla
    Anthony Wong
    Bang-Hyon Lee
    Jung-Ha Kim
    [J]. Journal of Electrical Engineering & Technology, 2022, 17 : 655 - 664
  • [7] Real-time lane and obstacle detection on the gold system
    Bertozzi, M
    Broggi, A
    [J]. PROCEEDINGS OF THE 1996 IEEE INTELLIGENT VEHICLES SYMPOSIUM, 1996, : 213 - 218
  • [8] Real-Time Road Lane Detection with Commodity Hardware
    Sakjiraphong, Somchok
    Pinho, Andre
    Dailey, Matthew N.
    Ekpanyapong, Mongkol
    Tavares, Adriano
    [J]. 2014 INTERNATIONAL ELECTRICAL ENGINEERING CONGRESS (IEECON), 2014,
  • [9] A Real-time Semantic Segmentation Model for Lane Detection
    Ma, Chen-Xu
    Li, Jing-Ang
    Han, Yong-Hua
    Wang, Yu-Meng
    Mu, Hai-Bo
    Jiang, Lu-Rong
    [J]. Journal of Network Intelligence, 2024, 9 (04): : 2234 - 2257
  • [10] Robust Lane Detection and Tracking for Real-Time Applications
    Lee, Chanho
    Moon, Ji-Hyun
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2018, 19 (12) : 4043 - 4048