Salient Object Detection via Multiple Instance Joint Re-Learning

被引:49
|
作者
Ma, Guangxiao [1 ]
Chen, Chenglizhao [1 ,2 ]
Li, Shuai [3 ]
Peng, Chong [2 ]
Hao, Aimin [1 ,3 ]
Qin, Hong [4 ]
机构
[1] Beihang Univ, Qingdao Res Inst, Qingdao 266100, Peoples R China
[2] Qingdao Univ, Qingdao 266071, Peoples R China
[3] Beihang Univ, Sch Comp Sci & Engn, Beijing 100191, Peoples R China
[4] SUNY Stony Brook, Stony Brook, NY 11794 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Feature extraction; Object detection; Saliency detection; Visualization; Deep learning; Correlation; Topology; Salient Object Detection Inter-image Corres-pondence; Multiple Instance Learning; Joint Re-Learning; VIDEO; OPTIMIZATION; DRIVEN; FUSION; MODEL;
D O I
10.1109/TMM.2019.2929943
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years deep neural networks have been widely applied to visual saliency detection tasks with remarkable detection performance improvements. As for the salient object detection in single image, the automatically computed convolutional features frequently demonstrate high discriminative power to distinguish salient foregrounds from its non-salient surroundings in most cases. Yet, the obstinate feature conflicts still persist, which naturally gives rise to the learning ambiguity, arriving at massive failure detections. To solve such problem, we propose to jointly re-learn common consistency of inter-image saliency and then use it to boost the detection performance. Its core rationale is to utilize the easy-to-detect cases to re-boost much harder ones. Compared with the conventional methods, which focus on their problem domain within the single image scope, our method attempts to utilize those beyond-scope information to facilitate the current salient object detection. To validate our new approach, we have conducted a comprehensive quantitative comparisons between our approach and 13 state-of-the-art methods over 5 publicly available benchmarks, and all the results suggest the advantage of our approach in terms of accuracy, reliability, and versatility.
引用
收藏
页码:324 / 336
页数:13
相关论文
共 50 条
  • [21] Joint salient object detection and existence prediction
    Huaizu Jiang
    Ming-Ming Cheng
    Shi-Jie Li
    Ali Borji
    Jingdong Wang
    Frontiers of Computer Science, 2019, 13 : 778 - 788
  • [22] Joint salient object detection and existence prediction
    Jiang, Huaizu
    Cheng, Ming-Ming
    Li, Shi-Jie
    Borji, Ali
    Wang, Jingdong
    FRONTIERS OF COMPUTER SCIENCE, 2019, 13 (04) : 778 - 788
  • [23] Salient object detection via point-to-set metric learning
    You, Jia
    Zhang, Lihe
    Qi, Jinqing
    Lu, Huchuan
    PATTERN RECOGNITION LETTERS, 2016, 84 : 85 - 90
  • [24] Multimodal salient object detection via adversarial learning with collaborative generator
    Tu, Zhengzheng
    Yang, Wenfang
    Wang, Kunpeng
    Hussain, Amir
    Luo, Bin
    Li, Chenglong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
  • [25] Continuation Multiple Instance Learning for Weakly and Fully Supervised Object Detection
    Ye, Qixiang
    Wan, Fang
    Liu, Chang
    Huang, Qingming
    Ji, Xiangyang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5452 - 5466
  • [26] Hierarchical Learning for Salient Object Detection
    Zheng, Qi
    Zhang, Peng
    You, Xinge
    Wang, Fangzhao
    Liu, Zida
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 192 - 197
  • [27] Adversarial Attacks Assessment of Salient Object Detection via Symbolic Learning
    Olague, Gustavo
    Pineda, Roberto
    Ibarra-Vazquez, Gerardo
    Olague, Matthieu
    Martinez, Axel
    Bakshi, Sambit
    Vargas, Jonathan
    Reducindo, Isnardo
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2023, 11 (04) : 1018 - 1030
  • [28] Lightweight Salient Object Detection via Hierarchical Visual Perception Learning
    Liu, Yun
    Gu, Yu-Chao
    Zhang, Xin-Yu
    Wang, Weiwei
    Cheng, Ming-Ming
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (09) : 4439 - 4449
  • [29] Residual Learning for Salient Object Detection
    Feng, Mengyang
    Lu, Huchuan
    Yu, Yizhou
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4696 - 4708
  • [30] Image region re-weighting via multiple instance learning
    Gondra, Iker
    Xu, Tao
    SIGNAL IMAGE AND VIDEO PROCESSING, 2010, 4 (04) : 409 - 417