Multi-Scale Depthwise Separable Convolution for Semantic Segmentation in Street-Road Scenes

被引:10
|
作者
Dai, Yingpeng [1 ]
Li, Chenglin [2 ]
Su, Xiaohang [3 ]
Liu, Hongxian [2 ]
Li, Jiehao [2 ,3 ]
机构
[1] Chinese Acad Agr Sci, Tobacco Res Inst, Qingdao 266101, Peoples R China
[2] South China Agr Univ, Coll Engn, Key Lab Key Technol Agr Machine & Equipment, Minist Educ, Guangzhou 510642, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Peoples R China
基金
中国国家自然科学基金;
关键词
semantic segmentation; Depthwise Separable Convolution; multi-scale feature; fully neural networks;
D O I
10.3390/rs15102649
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Vision is an important way for unmanned mobile platforms to understand surrounding environmental information. For an unmanned mobile platform, quickly and accurately obtaining environmental information is a basic requirement for its subsequent visual tasks. Based on this, a unique convolution module called Multi-Scale Depthwise Separable Convolution module is proposed for real-time semantic segmentation. This module mainly consists of concatenation pointwise convolution and multi-scale depthwise convolution. Not only does the concatenation pointwise convolution change the number of channels, but it also combines the spatial features from the multi-scale depthwise convolution operations to produce additional features. The Multi-Scale Depthwise Separable Convolution module can strengthen the non-linear relationship between input and output. Specifically, the multi-scale depthwise convolution module extracts multi-scale spatial features while remaining lightweight. This fully uses multi-scale information to describe objects despite their different sizes. Here, Mean Intersection over Union (MIoU), parameters, and inference speed were used to describe the performance of the proposed network. On the Camvid, KITTI, and Cityscapes datasets, the proposed algorithm compromised between accuracy and memory in comparison to widely used and cutting-edge algorithms. In particular, the proposed algorithm acquired 61.02 MIoU with 2.68 M parameters on the Camvid test dataset.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Multi-Scale Residual Depthwise Separable Convolution for Metro Passenger Flow Prediction
    Li, Taoying
    Liu, Lu
    Li, Meng
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (20):
  • [2] Multi-scale depthwise separable convolution facial expression recognition embedded in attention mechanism
    Song Y.
    Gao S.
    Zeng H.
    Xiong G.
    [J]. Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2022, 48 (12): : 2381 - 2387
  • [3] ADSCNet: asymmetric depthwise separable convolution for semantic segmentation in real-time
    Jiawei Wang
    Hongyun Xiong
    Haibo Wang
    Xiaohong Nian
    [J]. Applied Intelligence, 2020, 50 : 1045 - 1056
  • [4] ADSCNet: asymmetric depthwise separable convolution for semantic segmentation in real-time
    Wang, Jiawei
    Xiong, Hongyun
    Wang, Haibo
    Nian, Xiaohong
    [J]. APPLIED INTELLIGENCE, 2020, 50 (04) : 1045 - 1056
  • [5] Research on Multi-scale Residual UNet Fused with Depthwise Separable Convolution in PolSAR Terrain Classification
    Xie, Wen
    Wang, Ruonan
    Yang, Xin
    Li, Yongheng
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 2975 - 2985
  • [6] Multi-scale Xception based depthwise separable convolution for single image super-resolution
    Muhammad, Wazir
    Aramvith, Supavadee
    Onoye, Takao
    [J]. PLOS ONE, 2021, 16 (08):
  • [7] OUTSIDE: Multi-Scale Semantic Segmentation of Universal Outdoor Scenes
    Gerhardt, Christoph
    Weidner, Florian
    Broll, Wolfgang
    [J]. IEEE MMSP 2021: 2021 IEEE 23RD INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2021,
  • [8] Multi-Scale Convolutional Features Network for Semantic Segmentation in Indoor Scenes
    Wang, Yanran
    Chen, Qingliang
    Chen, Shilang
    Wu, Junjun
    [J]. IEEE ACCESS, 2020, 8 : 89575 - 89583
  • [9] A multi-attention and depthwise separable convolution network for medical image segmentation
    Zhou, Yuxiang
    Kang, Xin
    Ren, Fuji
    Lu, Huimin
    Nakagawa, Satoshi
    Shan, Xiao
    [J]. NEUROCOMPUTING, 2024, 564
  • [10] MDSC-Net: A multi-scale depthwise separable convolutional neural network for skin lesion segmentation
    Jiang, Yun
    Qiao, Hao
    Zhang, Zequn
    Wang, Meiqi
    Yan, Wei
    Chen, Jie
    [J]. IET IMAGE PROCESSING, 2023, 17 (13) : 3713 - 3727