Dual context prior and refined prediction for semantic segmentation

被引:9
|
作者
Chen, Long [1 ]
Liu, Jiajie [1 ]
Li, Han [1 ]
Zhan, Wujing [1 ]
Zhou, Baoding [2 ,3 ,4 ]
Li, Qingquan [2 ,3 ]
机构
[1] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
[2] Shenzhen Univ, Guangdong Key Lab Urban Informat, Shenzhen, Peoples R China
[3] Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[4] Shenzhen Univ, Civil & Transportat Engn, Shenzhen, Peoples R China
关键词
Deep learning; semantic segmentation; linear spatial propagation; context information;
D O I
10.1080/10095020.2020.1785957
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Recently, the focus of semantic segmentation research has shifted to the aggregation of context prior and refined boundary. A typical network adopts context aggregation modules to extract rich semantic features. It also utilizes top-down connection and skips connections for refining boundary details. But it still remains disadvantage, an obvious fact is that the problem of false segmentation occurs as the object has very different textures. The fusion of weak semantic and low-level features leads to context prior degradation. To tackle the issue, we propose a simple yet effective network, which integrates dual context prior and spatial propagation-dubbed DSPNet. It extends two mainstreams of current segmentation researches: (1) Designing a dual context prior module, which pays attention to context prior again with a shortcut connection. (2) The network can inherently learn semantic aware affinity values for each pixel and refine the segmentation. We will present detailed comparisons, which perform on PASCAL VOC 2012 and Cityscapes. The result demonstrates the validation of our approach.
引用
收藏
页码:228 / 240
页数:13
相关论文
共 50 条
  • [41] Pedestrian instance segmentation with prior structure of semantic parts
    Chu, Huazhen
    Ma, Huimin
    Li, Xi
    [J]. PATTERN RECOGNITION LETTERS, 2021, 149 : 9 - 16
  • [42] Domain-Agnostic Prior for Transfer Semantic Segmentation
    Huo, Xinyue
    Xie, Lingxi
    Hu, Hengtong
    Zhou, Wengang
    Li, Houqiang
    Tian, Qi
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7065 - 7075
  • [43] Pedestrian instance segmentation with prior structure of semantic parts
    Chu, Huazhen
    Ma, Huimin
    Li, Xi
    [J]. Pattern Recognition Letters, 2021, 149 : 9 - 16
  • [44] Learnable scene prior for point cloud semantic segmentation
    Chai, Yuanhao
    Gong, Jingyu
    Tan, Xin
    Xu, Jiachen
    Xie, Yuan
    Ma, Lizhuang
    [J]. VISUAL COMPUTER, 2024,
  • [45] Weakly Supervised Semantic Segmentation Based on Semantic Texton Forest and Saliency Prior
    Han Zheng
    Xiao Zhitao
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (03) : 610 - 617
  • [46] Deep Dual Learning for Semantic Image Segmentation
    Luo, Ping
    Wang, Guangrun
    Lin, Liang
    Wang, Xiaogang
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2737 - 2745
  • [47] Multispecies Fruit Flower Detection Using a Refined Semantic Segmentation Network
    Dias, Philipe A.
    Tabb, Amy
    Medeiros, Henry
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04): : 3003 - 3010
  • [48] Semantic object processing is modulated by prior scene context
    Krugliak, Alexandra
    Draschkow, Dejan
    Vo, Melissa L. -H.
    Clarke, Alex
    [J]. LANGUAGE COGNITION AND NEUROSCIENCE, 2023,
  • [49] DeSCoVeR: Debiased Semantic Context Prior for Venue Recommendation
    Rajanala, Sailaja
    Pal, Arghya
    Singh, Manish
    Phan, Raphael C-W
    Wong, KokSheik
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2456 - 2461
  • [50] Joint Future Semantic and Instance Segmentation Prediction
    Couprie, Camille
    Luc, Pauline
    Verbeek, Jakob
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT III, 2019, 11131 : 154 - 168