Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation

被引:2
|
作者
Zheng, Xin [1 ]
Li, Zhengqu [1 ]
Liu, Deyang [1 ]
Zhou, Xiaofei [2 ]
Shan, Caifeng [3 ,4 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing 246000, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310061, Peoples R China
[3] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[4] Nanjing Univ, Sch Intelligence Sci & Technol, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image restoration; Three-dimensional displays; Object detection; Light fields; Fuses; Light field; salient object detection; implicit neural representation; spatial attention; DEPTH ESTIMATION;
D O I
10.1109/TCSVT.2024.3437685
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, many Light Field Salient Object Detection (LF SOD) methods have been proposed. However, guaranteeing the integrality and recovering more high-frequency details of the generated salient object map still remain challenging. To this end, we propose a spatial attention-guided LF SOD network with implicit neural representation to further improve LF SOD performance. We adopt an encoder-decoder structure for model construction. In order to ensure the completeness of the generated salient object map, a multi-modal and multi-scale feature fusion module is designed in the encoder part to refine the salient regions within all-in-focus image and aggregate the focal stack and all-in-focus image in spatial attention-guided manner. In order to recover more high-frequency details of the obtained salient object map, an implicit detail restoration module is proposed in the decoder part. In virtue of implicit neural representation, we convert the detail restoration problem into a functional mapping problem. By further integrating the self-attention mechanism, the derived saliency map can be depicted at a more refined level. Comprehensive experimental results demonstrate the superiority of the proposed method. Ablation studies and visual comparisons further validate that the proposed method can guarantee the integrality and recover more high-frequency detail information of the obtained saliency map. The code is publicly available at https://github.com/ldyorchid/LFSOD-Net.
引用
收藏
页码:12437 / 12449
页数:13
相关论文
共 50 条
  • [1] Spatial attention-guided deformable fusion network for salient object detection
    Yang, Aiping
    Liu, Yan
    Cheng, Simeng
    Cao, Jiale
    Ji, Zhong
    Pang, Yanwei
    MULTIMEDIA SYSTEMS, 2023, 29 (05) : 2563 - 2573
  • [2] Spatial attention-guided deformable fusion network for salient object detection
    Aiping Yang
    Yan Liu
    Simeng Cheng
    Jiale Cao
    Zhong Ji
    Yanwei Pang
    Multimedia Systems, 2023, 29 : 2563 - 2573
  • [3] SDETR: ATTENTION-GUIDED SALIENT OBJECT DETECTION WITH TRANSFORMER
    Liu, Guanze
    Xu, Bo
    Huang, Han
    Lu, Cheng
    Guo, Yandong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1611 - 1615
  • [4] Attention-guided salient object detection using autoencoder regularization
    Xu, Cheng
    Liu, Xianhui
    Zhao, Weidong
    APPLIED INTELLIGENCE, 2023, 53 (06) : 6481 - 6495
  • [5] Attention-guided salient object detection using autoencoder regularization
    Cheng Xu
    Xianhui Liu
    Weidong Zhao
    Applied Intelligence, 2023, 53 : 6481 - 6495
  • [6] ADMNet: Attention-Guided Densely Multi-Scale Network for Lightweight Salient Object Detection
    Zhou, Xiaofei
    Shen, Kunye
    Liu, Zhi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10828 - 10841
  • [7] Dense Attention-Guided Cascaded Network for Salient Object Detection of Strip Steel Surface Defects
    Zhou, Xiaofei
    Fang, Hao
    Liu, Zhi
    Zheng, Bolun
    Sun, Yaoqi
    Zhang, Jiyong
    Yan, Chenggang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [8] Object Detection by Attention-Guided Feature Fusion Network
    Shi, Yuxuan
    Fan, Yue
    Xu, Siqi
    Gao, Yue
    Gao, Ran
    SYMMETRY-BASEL, 2022, 14 (05):
  • [9] Attention-guided Multi-modality Interaction Network for RGB-D Salient Object Detection
    Wang, Ruimin
    Wang, Fasheng
    Su, Yiming
    Sun, Jing
    Sun, Fuming
    Li, Haojie
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (03)
  • [10] Spatial attention guided cGAN for improved salient object detection
    Dhara, Gayathri
    Kumar, Ravi Kant
    FRONTIERS IN COMPUTER SCIENCE, 2024, 6