Bmsmlet: boosting multi-scale information on multi-level aggregated features for salient object detection

被引:0
|
作者
Wu, Ziwei [1 ]
Jia, Tong [1 ,2 ]
Wu, Yunhe [1 ]
Zeng, Zhikang [1 ]
Liang, Feng [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Minist Educ, Key Lab Data Analyt & Optimizat Smart Ind, Shenyang, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 02期
基金
中国国家自然科学基金;
关键词
Salient object detection; Multi-scale information; Multi-level information; Aggregated features; ATTENTION; NETWORK; MODEL;
D O I
10.1007/s00371-023-02836-8
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Nowadays, salient object detection methods based on deep learning have become a research focus. Therefore, how to reveal the representation mechanism and association rules of features at different levels and scales in order to improve the accuracy of salient object detection is a key issue to be solved. This paper proposes a salient object detection method to boost multi-scale information on multi-level aggregated features, which can accurately and flexibly aggregate multi-scale feature information via effective multi-level feature utilization. First, a scalable feature pyramid module is proposed, which can aggregate deep feature information in shallow features, thus obtaining aggregated features between different levels. Then, the global information enhancement module is built in the bottom-up network path to make up for the lost or weakened feature information in the process of multi-scale integration feature transmission. Next, internally convolve each level of aggregated feature via self-interactive module to enrich multi-scale information and improve the multi-scale representation ability of aggregated features. Finally, the global associativity loss function is designed to solve the noise caused by multi-scale variation so as to optimize the network training process, which effectively compensates for the deficiency of cross-entropy in the salient object detection task. The experimental results on four public datasets show that the performance of the proposed method has improved in contrast to the state-of-the-art methods.
引用
收藏
页码:1131 / 1144
页数:14
相关论文
共 50 条
  • [1] Bmsmlet: boosting multi-scale information on multi-level aggregated features for salient object detection
    Ziwei Wu
    Tong Jia
    Yunhe Wu
    Zhikang Zeng
    Feng Liang
    [J]. The Visual Computer, 2024, 40 (2) : 1131 - 1144
  • [2] Multi-level and multi-scale deep saliency network for salient object detection
    Zhang, Qing
    Lin, Jiajun
    Zhuge, Jingling
    Yuan, Wenhao
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 59 : 415 - 424
  • [3] Salient Object Detection Based on Multi-scale Feature Extraction and Multi-level Feature Fusion
    Li, Lingli
    Meng, Lingbing
    Li, Jinbao
    [J]. Gongcheng Kexue Yu Jishu/Advanced Engineering Sciences, 2021, 53 (01): : 170 - 177
  • [4] Predicting salient object via multi-level features
    Lin, Mingqiang
    Zhang, Chenbin
    Chen, Zonghai
    [J]. NEUROCOMPUTING, 2016, 205 : 301 - 310
  • [5] Video Salient Object Detection Via Multi-level Spatiotemporal Bidirectional Network Using Multi-scale Transfer Learning
    Sharma, Gaurav
    Singh, Maheep
    Berwal, Krishan
    [J]. IETE JOURNAL OF RESEARCH, 2024,
  • [6] SALIENT OBJECT DETECTION BY MULTI-LEVEL FEATURES LEARNING DETERMINED SPARSE RECONSTRUCTION
    Yan, Xiaoyun
    Wang, Yuehuan
    Song, Qiong
    Dai, Kaiheng
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 2762 - 2766
  • [7] Salient Object Detection Using Multi-Scale Features with Attention Recurrent Mechanism
    Lu, Shanmei
    Guo, Qiang
    Wang, Ren
    Zhang, Caiming
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (12): : 1926 - 1937
  • [8] Salient Object Detection with CNNs and Multi-scale CRFs
    Xu, Yingyue
    Hong, Xiaopeng
    Zhao, Guoying
    [J]. IMAGE ANALYSIS, 2019, 11482 : 233 - 245
  • [9] Salient object detection based on multi-scale contrast
    Wang, Hai
    Dai, Lei
    Cai, Yingfeng
    Sun, Xiaoqiang
    Chen, Long
    [J]. NEURAL NETWORKS, 2018, 101 : 47 - 56
  • [10] Attention to the Scale : Deep Multi-Scale Salient Object Detection
    Zhang, Jing
    Dai, Yuchao
    Li, Bo
    He, Mingyi
    [J]. 2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 105 - 111