A Keypoint-based Global Association Network for Lane Detection

被引:33
|
作者
Wang, Jinsheng [1 ,3 ]
Ma, Yinchao [2 ,3 ]
Huang, Shaofei [3 ]
Hui, Tianrui [4 ,5 ]
Wang, Fei [2 ]
Qian, Chen [3 ]
Zhang, Tianzhu [2 ]
机构
[1] Peking Univ, Beijing, Peoples R China
[2] Univ Sci & Technol China, Hefei, Anhui, Peoples R China
[3] SenseTime Res, Shanghai, Peoples R China
[4] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[5] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52688.2022.00145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Lane detection is a challenging task that requires predicting complex topology shapes of lane lines and distinguishing different types of lanes simultaneously. Earlier works follow a top-down roadmap to regress predefined anchors into various shapes of lane lines, which lacks enough flexibility to fit complex shapes of lanes due to the fixed anchor shapes. Lately, some works propose to formulate lane detection as a keypoint estimation problem to describe the shapes of lane lines more flexibly and gradually group adjacent keypoints belonging to the same lane line in a pointby-point manner, which is inefficient and time-consuming during post-processing. In this paper, we propose a Global Association Network (GANet) to formulate the lane detection problem from a new perspective, where each keypoint is directly regressed to the starting point of the lane line instead of point-by-point extension. Concretely, the association of keypoints to their belonged lane line is conducted by predicting their offsets to the corresponding starting points of lanes globally without dependence on each other, which could be done in parallel to greatly improve efficiency. In addition, we further propose a Lane-aware Feature Aggregator (LFA), which adaptively captures the local correlations between adjacent keypoints to supplement local information to the global association. Extensive experiments on two popular lane detection benchmarks show that our method outperforms previous methods with F1 score of 79.63% on CULane and 97.71% on Tusimple dataset with high FPS.
引用
收藏
页码:1382 / 1391
页数:10
相关论文
共 50 条
  • [1] Local Keypoint-Based Image Detector with Object Detection
    Grycuk, Rafal
    Scherer, Magdalena
    Voloshynovskiy, Sviatoslav
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2017, PT I, 2017, 10245 : 507 - 517
  • [2] A Keypoint-Based Region Duplication Forgery Detection Algorithm
    Emam, Mahmoud
    Han, Qi
    Yu, Liyang
    Zhang, Hongli
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2016, E99D (09) : 2413 - 2416
  • [3] A Keypoint-Based Approach Toward Scenery Character Detection
    Uchida, Seiichi
    Shigeyoshi, Yuki
    Kunishige, Yasuhiro
    Yaokai, Feng
    [J]. 11TH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR 2011), 2011, : 819 - 823
  • [4] Gradient Corner Pooling for Keypoint-Based Object Detection
    Li, Xuyang
    Xie, Xuemei
    Yu, Mingxuan
    Luo, Jiakai
    Rao, Chengwei
    Shi, Guangming
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 1460 - 1467
  • [5] Keypoint-based passive method for image manipulation detection
    Prakash, Choudhary Shyam
    Om, Hari
    Maheshkar, Sushila
    Maheshkar, Vikas
    [J]. COGENT ENGINEERING, 2018, 5 (01): : 1 - 19
  • [6] SCPNet: Self-constrained parallelism network for keypoint-based lightweight object detection?
    Zhong, Xian
    Wang, Mengdie
    Liu, Wenxuan
    Yuan, Jingling
    Huang, Wenxin
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [7] Keypoint-Based Keyframe Selection
    Guan, Genliang
    Wang, Zhiyong
    Lu, Shiyang
    Da Deng, Jeremiah
    Feng, David Dagan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (04) : 729 - 734
  • [8] Temporally Robust Global Motion Compensation by Keypoint-Based Congealing
    Safdarnejad, S. Morteza
    Atoum, Yousef
    Liu, Xiaoming
    [J]. COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 : 101 - 119
  • [9] Representations of Keypoint-Based Semantic Concept Detection: A Comprehensive Study
    Jiang, Yu-Gang
    Yang, Jun
    Ngo, Chong-Wah
    Hauptmann, Alexander G.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2010, 12 (01) : 42 - 53
  • [10] A keypoint-based object detection method with attention mechanism and feature fusion
    Wang, Hui
    Yang, Tangwen
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2113 - 2118