Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation

被引:2
|
作者
Zheng, Xin [1 ]
Li, Zhengqu [1 ]
Liu, Deyang [1 ]
Zhou, Xiaofei [2 ]
Shan, Caifeng [3 ,4 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing 246000, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310061, Peoples R China
[3] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[4] Nanjing Univ, Sch Intelligence Sci & Technol, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image restoration; Three-dimensional displays; Object detection; Light fields; Fuses; Light field; salient object detection; implicit neural representation; spatial attention; DEPTH ESTIMATION;
D O I
10.1109/TCSVT.2024.3437685
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, many Light Field Salient Object Detection (LF SOD) methods have been proposed. However, guaranteeing the integrality and recovering more high-frequency details of the generated salient object map still remain challenging. To this end, we propose a spatial attention-guided LF SOD network with implicit neural representation to further improve LF SOD performance. We adopt an encoder-decoder structure for model construction. In order to ensure the completeness of the generated salient object map, a multi-modal and multi-scale feature fusion module is designed in the encoder part to refine the salient regions within all-in-focus image and aggregate the focal stack and all-in-focus image in spatial attention-guided manner. In order to recover more high-frequency details of the obtained salient object map, an implicit detail restoration module is proposed in the decoder part. In virtue of implicit neural representation, we convert the detail restoration problem into a functional mapping problem. By further integrating the self-attention mechanism, the derived saliency map can be depicted at a more refined level. Comprehensive experimental results demonstrate the superiority of the proposed method. Ablation studies and visual comparisons further validate that the proposed method can guarantee the integrality and recover more high-frequency detail information of the obtained saliency map. The code is publicly available at https://github.com/ldyorchid/LFSOD-Net.
引用
收藏
页码:12437 / 12449
页数:13
相关论文
共 50 条
  • [31] Attention-guided neural network for early dementia detection using MRS data
    Kherchouche, Anouar
    Ben-Ahmed, Olfa
    Guillevin, Carole
    Tremblais, Benoit
    Julian, Adrien
    Fernandez-Maloigne, Christine
    Guillevin, Remy
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2022, 99
  • [32] Attention-Guided Multitask Convolutional Neural Network for Power Line Parts Detection
    Zhang, Hui
    Wu, Liuchen
    Chen, Yurong
    Chen, Ruibo
    Kong, Senlin
    Wang, Yaonan
    Hu, Jianwen
    Wu, Jonathan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [33] Motion Guided Attention for Video Salient Object Detection
    Li, Haofeng
    Chen, Guanqi
    Li, Guanbin
    Yu, Yizhou
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7273 - 7282
  • [34] AG-YOLO: Attention-guided network for real-time object detection
    Hangyu Zhu
    Libo Sun
    Wenhu Qin
    Feng Tian
    Multimedia Tools and Applications, 2024, 83 : 28197 - 28213
  • [35] AG-YOLO: Attention-guided network for real-time object detection
    Zhu, Hangyu
    Sun, Libo
    Qin, Wenhu
    Tian, Feng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (09) : 28197 - 28213
  • [36] LRNet: lightweight attention-oriented residual fusion network for light field salient object detection
    Ma, Shuai
    Zhu, Xusheng
    Xu, Long
    Zhou, Li
    Chen, Daixin
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [37] Attention-guided Low light enhancement CNN Network
    Liang, Xiwen
    Yan, Xiaoning
    Xu, Nenghua
    Chen, Xiaoyan
    Feng, Hao
    JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2023, 9 (04):
  • [38] Siamese Progressive Attention-Guided Fusion Network for Object Tracking
    Fan Y.
    Song X.
    Song, Xiaoning (x.song@jiangnan.edu.cn), 1600, Institute of Computing Technology (33): : 199 - 206
  • [39] Channel-Spatial Mutual Attention Network for 360° Salient Object Detection
    Zhang, Yi
    Hamidouche, Wassim
    Deforges, Olivier
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3436 - 3442
  • [40] Occlusion-aware Bi-directional Guided Network for Light Field Salient Object Detection
    Jing, Dong
    Zhang, Shuo
    Cong, Runmin
    Lin, Youfang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1692 - 1701