DIPONet: Dual-information progressive optimization network for salient object detection

被引:9
|
作者
Liu, Jing [1 ,2 ]
Yuan, Min [1 ]
Huang, Xiangdong [1 ]
Su, Yuting [1 ]
Yang, Xiaokang [2 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Minist Educ, Key Lab Artificial Intelligence, Shanghai 200240, Peoples R China
关键词
Salient object detection; Salient edge detection; Jointly optimization; Deep learning; ATTENTION; MODEL;
D O I
10.1016/j.dsp.2022.103425
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the rise of fully convolutional networks (FCN), in recent years, more and more models of salient object detection based on deep learning have used or modified FCN to perform pixel-level saliency prediction. However, many existing algorithms lack accurate saliency edges due to insufficient use of edge information. In this paper, we solve this problem by focusing on the complementarity between salient object information and salient edge information. Because salient edge features contain more details, the boundary of salient object will be more accurate when fused with edge information. Salient object features can help edge features to better locate the foreground object and filter out background interference. Accordingly, we propose a dual-information progressive optimization network (DIPONet) for salient object detection. In the first step, we extract salient edge features from the low-level of VGG or ResNet backbone and salient object features from the subsequent layers separately, and send them to group optimization fusion modules (GOFMs) which aim to achieve self-optimization of these two kinds of features. In the second step, we design a model named dual-stream information optimization (DSIO) module based on the logical relationship between salient object information and salient edge information to jointly optimize these two kinds of features in a progressive fusion way. Benefiting from the rich edge information in salient edge features and location information in salient object features, the fused features can help detecting salient objects with more accurate boundaries. Excessive experimental results conducted on five benchmark datasets show that our proposed model surpasses the state-of-the-art models and can produce accurate salient object predictions with sharp details. (C) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Dual-Branch Network of Information Mutual Optimization for Salient Object Detection
    Chen, Zijun
    Zhan, Yinwei
    Gao, Shanglei
    [J]. IEEE ACCESS, 2023, 11 : 46120 - 46131
  • [2] Boundary Information Progressive Guidance Network for Salient Object Detection
    Yao, Zhaojian
    Wang, Luping
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4236 - 4249
  • [3] Progressive Dual-Attention Residual Network for Salient Object Detection
    Zhang, Liqian
    Zhang, Qing
    Zhao, Rui
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) : 5902 - 5915
  • [4] Dual pyramid network for salient object detection
    Xu, Xuemiao
    Chen, Jiaxing
    Zhang, Huaidong
    Han, Guoqiang
    [J]. NEUROCOMPUTING, 2020, 375 : 113 - 123
  • [5] Progressive Feature Polishing Network for Salient Object Detection
    Wang, Bo
    Chen, Quan
    Zhou, Min
    Zhang, Zhiqiang
    Jin, Xiaogang
    Gai, Kun
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12128 - 12135
  • [6] A Simple Network with Progressive Structure for Salient Object Detection
    Zhou, Boyi
    Yang, Gang
    Wan, Xin
    Wang, Yutao
    Liu, Chang
    Wang, Hangxu
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 397 - 408
  • [7] GPONet: A two-stream gated progressive optimization network for salient object detection
    Yi, Yugen
    Zhang, Ningyi
    Zhou, Wei
    Shi, Yanjiao
    Xie, Gengsheng
    Wang, Jianzhong
    [J]. PATTERN RECOGNITION, 2024, 150
  • [8] Progressive Attention Guided Recurrent Network for Salient Object Detection
    Zhang, Xiaoning
    Wang, Tiantian
    Qi, Jinqing
    Lu, Huchuan
    Wang, Gang
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 714 - 722
  • [9] DCNP: Dual-Information Compensation Network for Pansharpening
    Yang, Yong
    Su, Zhao
    Huang, Shuying
    Wan, Weiguo
    Tu, Wei
    Chen, Changjie
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] DIG: dual interaction and guidance network for salient object detection
    Ning Jia
    Yufei Chen
    Xianhui Liu
    Hui Wang
    [J]. Applied Intelligence, 2023, 53 : 28039 - 28053