Non-Local Deep Features for Salient Object Detection

被引:401
|
作者
Luo, Zhiming [1 ,2 ,3 ]
Mishra, Akshaya [4 ]
Achkar, Andrew [4 ]
Eichel, Justin [4 ]
Li, Shaozi [1 ,2 ]
Jodoin, Pierre-Marc [3 ]
机构
[1] Xiamen Univ, Dept Cognit Sci, Xiamen, Peoples R China
[2] Xiamen Univ, Fujian Key Lab Brain Inspired Comp Tech & Applica, Xiamen, Peoples R China
[3] Univ Sherbrooke, Dept Comp Sci, Sherbrooke, PQ, Canada
[4] Miovis Technol Inc, Kitchener, ON, Canada
关键词
IMAGE; SEGMENTATION; MUMFORD;
D O I
10.1109/CVPR.2017.698
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Saliency detection aims to highlight the most relevant objects in an image. Methods using conventional models struggle whenever salient objects are pictured on top of a cluttered background while deep neural nets suffer from excess complexity and slow evaluation speeds. In this paper, we propose a simplified convolutional neural network which combines local and global information through a mult-iresolution 4 x 5 grid structure. Instead of enforcing spacial coherence with a CRF or superpixels as is usually the case, we implemented a loss function inspired by the Mumford-Shah functional which penalizes errors on the boundary. We trained our model on the MSRA-B dataset, and tested it on six different saliency benchmark datasets. Results show that our method is on par with the state-of-the-art while reducing computation time by a factor of 18 to 100 times, enabling near real-time, high performance saliency detection.
引用
下载
收藏
页码:6593 / 6601
页数:9
相关论文
共 50 条
  • [1] Infrared salient object detection based on global guided lightweight non-local deep features
    Liu, Zhaoying
    Zhang, Xuesi
    Jiang, Tianpeng
    Zhang, Ting
    Liu, Bo
    Waqas, Muhammad
    Li, Yujian
    INFRARED PHYSICS & TECHNOLOGY, 2021, 115
  • [2] Salient object detection in video using deep non-local neural networks
    Shokri, Mohammad
    Harati, Ahad
    Taba, Kimya
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 68
  • [3] Non-local duplicate pooling network for salient object detection
    Jiao, Jun
    Xue, Hui
    Ding, Jundi
    APPLIED INTELLIGENCE, 2021, 51 (10) : 6881 - 6894
  • [4] Non-local duplicate pooling network for salient object detection
    Jun Jiao
    Hui Xue
    Jundi Ding
    Applied Intelligence, 2021, 51 : 6881 - 6894
  • [5] Salient object detection with non-local feature enhancement and edge reconstruction
    Tao Xu
    Jingyao Jiang
    Lei Cai
    Haojie Chai
    Hanjun Ma
    Scientific Reports, 15 (1)
  • [6] Deep Embedding Features for Salient Object Detection
    Zhuge, Yunzhi
    Zeng, Yu
    Lu, Huchuan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9340 - 9347
  • [7] Edge-Guided Non-Local Fully Convolutional Network for Salient Object Detection
    Tu, Zhengzheng
    Ma, Yan
    Li, Chenglong
    Tang, Jin
    Luo, Bin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) : 582 - 593
  • [8] Salient Object Detection: Integrate Salient Features in the Deep Learning Framework
    Chen, Qixin
    Liu, Tie
    Shang, Yuanyuan
    Shao, Zhuhong
    Ding, Hui
    IEEE ACCESS, 2019, 7 : 152483 - 152492
  • [9] Recurrently Aggregating Deep Features for Salient Object Detection
    Hu, Xiaowei
    Zhu, Lei
    Qin, Jing
    Fu, Chi-Wing
    Heng, Pheng-Ann
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 6943 - 6950
  • [10] Video Salient Object Detection Using Spatiotemporal Deep Features
    Trung-Nghia Le
    Sugimoto, Akihiro
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) : 5002 - 5015