A Dense Feature Pyramid Network-Based Deep Learning Model for Road Marking Instance Segmentation Using MLS Point Clouds

被引:37
|
作者
Chen, Siyun [1 ,2 ,3 ]
Zhang, Zhenxin [1 ,2 ,3 ]
Zhong, Ruofei [1 ,2 ,3 ]
Zhang, Liqiang [4 ]
Ma, Hao [5 ]
Liu, Lirong [6 ]
机构
[1] Capital Normal Univ, Beijing Adv Innovat Ctr Imaging Theory & Technol, Key Lab 3D Informat Acquisit & Applicat, MOE, Beijing 100048, Peoples R China
[2] Capital Normal Univ, Coll Resource Environm & Tourism, Beijing 100048, Peoples R China
[3] Chinese Acad Surveying & Mapping, Beijing 100830, Peoples R China
[4] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Geog Sci, Beijing 100875, Peoples R China
[5] Geovis Tech Corp Ltd, Beijing 100830, Peoples R China
[6] MNR, Land Satellite Remote Sensing Applicat Ctr, Beijing 100048, Peoples R China
来源
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Roads; Feature extraction; Three-dimensional displays; Deep learning; Image segmentation; Data mining; Remote sensing; dense feature pyramid network (DFPN); instance segmentation; mobile laser scanning (MLS) point clouds; road markings; AUTOMATED EXTRACTION; CLASSIFICATION;
D O I
10.1109/TGRS.2020.2996617
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Accurate and efficient extraction of road marking plays an important role in road transportation engineering, automotive vision, and automatic driving. In this article, we proposed a dense feature pyramid network (DFPN)-based deep learning model, by considering the particularity and complexity of road marking. The DFPN concatenated its shallow feature channels with deep feature channels so that the shallow feature maps with high resolution and abundant image details can utilize the deep features. Thus, the DFPN can learn hierarchical deep detailed features. The designed deep learning model was trained end to end for road marking instance extraction with mobile laser scanning (MLS) point clouds. Then, we introduced the focal loss function into the optimization of deep learning model in road marking segmentation part, to pay more attention to the hard-classified samples with a large extent of background. In the experiments, our method can achieve better results than state-of-the-art methods on instance segmentation of road markings, which illustrated the advantage of the proposed method.
引用
收藏
页码:784 / 800
页数:17
相关论文
共 50 条
  • [1] A point-based deep learning network for semantic segmentation of MLS point clouds
    Han, Xu
    Dong, Zhen
    Yang, Bisheng
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 175 : 199 - 214
  • [2] Segmentation of individual trees in urban MLS point clouds using a deep learning framework based on cylindrical convolution network
    Jiang, Tengping
    Liu, Shan
    Zhang, Qinyu
    Xu, Xin
    Sun, Jian
    Wang, Yongjun
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 123
  • [3] Hyperspectral Image Instance Segmentation Using SpectralSpatial Feature Pyramid Network
    Fang, Leyuan
    Jiang, Yifan
    Yan, Yinglong
    Yue, Jun
    Deng, Yue
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] A Multiscale Deep Feature for the Instance Segmentation of Water Leakages in Tunnel Using MLS Point Cloud Intensity Images
    Liu, Shuang
    Sun, Haili
    Zhang, Zhenxin
    Li, Yuqi
    Zhong, Ruofei
    Li, Jincheng
    Chen, Siyun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] A two-stage approach for road marking extraction and modeling using MLS point clouds
    Mi, Xiaoxin
    Yang, Bisheng
    Dong, Zhen
    Liu, Chong
    Zong, Zeliang
    Yuan, Zhenchao
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 180 : 255 - 268
  • [6] Road-Side Individual Tree Segmentation from Urban MLS Point Clouds Using Metric Learning
    Wang, Pengcheng
    Tang, Yong
    Liao, Zefan
    Yan, Yao
    Dai, Lei
    Liu, Shan
    Jiang, Tengping
    [J]. REMOTE SENSING, 2023, 15 (08)
  • [7] INFNet :Deep instance feature chain learning network for panoptic segmentation
    Mao, Lin
    Ren, Feng-Zhi
    Yang, Da-Wei
    Zhang, Ru-Bo
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2020, 28 (12): : 2665 - 2673
  • [8] Road Environment Semantic Segmentation with Deep Learning from MLS Point Cloud Data
    Balado, Jesus
    Martinez-Sanchez, Joaquin
    Arias, Pedro
    Novo, Ana
    [J]. SENSORS, 2019, 19 (16)
  • [9] Dense feature pyramid fusion deep network for building segmentation in remote sensing image
    Tian Qinglin
    Zhao Yingjun
    Qin Kai
    Li Yao
    Chen Xuejiao
    [J]. SEVENTH SYMPOSIUM ON NOVEL PHOTOELECTRONIC DETECTION TECHNOLOGY AND APPLICATIONS, 2021, 11763
  • [10] Road marking extraction in UAV imagery using attentive capsule feature pyramid network
    Guan, Haiyan
    Lei, Xiangda
    Yu, Yongtao
    Zhao, Haohao
    Peng, Daifeng
    Marcato Junior, Jose
    Li, Jonathan
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 107