Dual context prior and refined prediction for semantic segmentation

被引:9
|
作者
Chen, Long [1 ]
Liu, Jiajie [1 ]
Li, Han [1 ]
Zhan, Wujing [1 ]
Zhou, Baoding [2 ,3 ,4 ]
Li, Qingquan [2 ,3 ]
机构
[1] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
[2] Shenzhen Univ, Guangdong Key Lab Urban Informat, Shenzhen, Peoples R China
[3] Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[4] Shenzhen Univ, Civil & Transportat Engn, Shenzhen, Peoples R China
关键词
Deep learning; semantic segmentation; linear spatial propagation; context information;
D O I
10.1080/10095020.2020.1785957
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Recently, the focus of semantic segmentation research has shifted to the aggregation of context prior and refined boundary. A typical network adopts context aggregation modules to extract rich semantic features. It also utilizes top-down connection and skips connections for refining boundary details. But it still remains disadvantage, an obvious fact is that the problem of false segmentation occurs as the object has very different textures. The fusion of weak semantic and low-level features leads to context prior degradation. To tackle the issue, we propose a simple yet effective network, which integrates dual context prior and spatial propagation-dubbed DSPNet. It extends two mainstreams of current segmentation researches: (1) Designing a dual context prior module, which pays attention to context prior again with a shortcut connection. (2) The network can inherently learn semantic aware affinity values for each pixel and refine the segmentation. We will present detailed comparisons, which perform on PASCAL VOC 2012 and Cityscapes. The result demonstrates the validation of our approach.
引用
收藏
页码:228 / 240
页数:13
相关论文
共 50 条
  • [1] Semantic Segmentation via Structured Refined Prediction and Dual Global Priors
    Chen, Long
    Zhan, Wujing
    Liu, Jiajie
    Tian, Wei
    Cao, Dongpu
    [J]. 2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), 2019, : 53 - 58
  • [2] Context Prior Guided Semantic Modeling for Biomedical Image Segmentation
    Wu, Huisi
    Wang, Zhaoze
    Li, Zhuoying
    Wen, Zhenkun
    Qin, Jing
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [3] Dual Context Network for real-time semantic segmentation
    Hong Yin
    Wenbin Xie
    Jingjing Zhang
    Yuanfa Zhang
    Weixing Zhu
    Jie Gao
    Yan Shao
    Yajun Li
    [J]. Machine Vision and Applications, 2023, 34
  • [4] Dual Context Network for real-time semantic segmentation
    Yin, Hong
    Xie, Wenbin
    Zhang, Jingjing
    Zhang, Yuanfa
    Zhu, Weixing
    Gao, Jie
    Shao, Yan
    Li, Yajun
    [J]. MACHINE VISION AND APPLICATIONS, 2023, 34 (02)
  • [5] Structured prediction for urban scene semantic segmentation with geographic context
    Volpi, Michele
    Ferrari, Vittorio
    [J]. 2015 JOINT URBAN REMOTE SENSING EVENT (JURSE), 2015,
  • [6] Attention-based dual context aggregation for image semantic segmentation
    Zhao, Dexin
    Qi, Zhiyang
    Yang, Ruixue
    Wang, Zhaohui
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (18) : 28201 - 28216
  • [7] Attention-based dual context aggregation for image semantic segmentation
    Dexin Zhao
    Zhiyang Qi
    Ruixue Yang
    Zhaohui Wang
    [J]. Multimedia Tools and Applications, 2021, 80 : 28201 - 28216
  • [8] Stair Fusion Network With Context-Refined Attention for Remote Sensing Image Semantic Segmentation
    Liu, Jia
    Hua, Wenyi
    Zhang, Wenhua
    Liu, Fang
    Xiao, Liang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 17
  • [9] Semantic Segmentation Using Fully Convolutional Networks and Random Walk with Prediction Prior
    Lei, Xiaoyu
    Lu, Yao
    Liu, Tingxi
    Shi, Xiaoxue
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT II, 2018, 10736 : 129 - 138
  • [10] Context Encoding for Semantic Segmentation
    Zhang, Hang
    Dana, Kristin
    Shi, Jianping
    Zhang, Zhongyue
    Wang, Xiaogang
    Tyagi, Ambrish
    Agrawal, Amit
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7151 - 7160