Dual context prior and refined prediction for semantic segmentation

被引:9
|
作者
Chen, Long [1 ]
Liu, Jiajie [1 ]
Li, Han [1 ]
Zhan, Wujing [1 ]
Zhou, Baoding [2 ,3 ,4 ]
Li, Qingquan [2 ,3 ]
机构
[1] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
[2] Shenzhen Univ, Guangdong Key Lab Urban Informat, Shenzhen, Peoples R China
[3] Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[4] Shenzhen Univ, Civil & Transportat Engn, Shenzhen, Peoples R China
关键词
Deep learning; semantic segmentation; linear spatial propagation; context information;
D O I
10.1080/10095020.2020.1785957
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Recently, the focus of semantic segmentation research has shifted to the aggregation of context prior and refined boundary. A typical network adopts context aggregation modules to extract rich semantic features. It also utilizes top-down connection and skips connections for refining boundary details. But it still remains disadvantage, an obvious fact is that the problem of false segmentation occurs as the object has very different textures. The fusion of weak semantic and low-level features leads to context prior degradation. To tackle the issue, we propose a simple yet effective network, which integrates dual context prior and spatial propagation-dubbed DSPNet. It extends two mainstreams of current segmentation researches: (1) Designing a dual context prior module, which pays attention to context prior again with a shortcut connection. (2) The network can inherently learn semantic aware affinity values for each pixel and refine the segmentation. We will present detailed comparisons, which perform on PASCAL VOC 2012 and Cityscapes. The result demonstrates the validation of our approach.
引用
收藏
页码:228 / 240
页数:13
相关论文
共 50 条
  • [31] Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation
    Yifu Liu
    Chenfeng Xu
    Zhihong Chen
    Chao Chen
    Han Zhao
    Xinyu Jin
    [J]. Neural Processing Letters, 2020, 51 : 2281 - 2299
  • [32] On Symbiosis of Attribute Prediction and Semantic Segmentation
    Kalayeh, Mahdi M.
    Shah, Mubarak
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) : 1620 - 1635
  • [33] Context from within: Hierarchical context modeling for semantic segmentation
    Nguyen, Kien
    Fookes, Clinton
    Sridharan, Sridha
    [J]. PATTERN RECOGNITION, 2020, 105
  • [34] Context from within: Hierarchical context modeling for semantic segmentation
    Nguyen K.
    Fookes C.
    Sridharan S.
    [J]. Pattern Recognition, 2020, 105
  • [35] Pyramidal region context module for semantic segmentation
    Liang, Tingting
    Zhao, Qijie
    Wang, Zhuoying
    Shan, Kaiyu
    Zhang, Huan
    Wang, Yongtao
    Tang, Zhi
    [J]. ACM International Conference Proceeding Series, 2019,
  • [36] Aggregating Region Context Information for Semantic Segmentation
    Guo, Zilin
    Wu, Dongyue
    Zhang, Qiang
    Sang, Nong
    Yu, ChangQian
    Gao, Changxin
    [J]. THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083
  • [37] Grid Saliency for Context Explanations of Semantic Segmentation
    Hoyer, Lukas
    Munoz, Mauricio
    Katiyar, Prateek
    Khoreva, Anna
    Fischer, Volker
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [38] A Review of Semantic Segmentation Based on Context Information
    Xu, Wei
    Yang, Lingjun
    Cao, Sanxing
    [J]. PROCEEDINGS OF 2018 IEEE 4TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2018), 2018, : 494 - 498
  • [39] HCNet: Hierarchical Context Network for Semantic Segmentation
    Chong, Yanwen
    Nie, Congchong
    Tao, Yulong
    Chen, Xiaoshu
    Pan, Shaoming
    [J]. IEEE ACCESS, 2020, 8 : 179213 - 179223
  • [40] Adaptive Pyramid Context Network for Semantic Segmentation
    He, Junjun
    Deng, Zhongying
    Zhou, Lei
    Wang, Yali
    Qiao, Yu
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7511 - 7520