Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation

被引:2
|
作者
Zheng, Xin [1 ]
Li, Zhengqu [1 ]
Liu, Deyang [1 ]
Zhou, Xiaofei [2 ]
Shan, Caifeng [3 ,4 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing 246000, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310061, Peoples R China
[3] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[4] Nanjing Univ, Sch Intelligence Sci & Technol, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image restoration; Three-dimensional displays; Object detection; Light fields; Fuses; Light field; salient object detection; implicit neural representation; spatial attention; DEPTH ESTIMATION;
D O I
10.1109/TCSVT.2024.3437685
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, many Light Field Salient Object Detection (LF SOD) methods have been proposed. However, guaranteeing the integrality and recovering more high-frequency details of the generated salient object map still remain challenging. To this end, we propose a spatial attention-guided LF SOD network with implicit neural representation to further improve LF SOD performance. We adopt an encoder-decoder structure for model construction. In order to ensure the completeness of the generated salient object map, a multi-modal and multi-scale feature fusion module is designed in the encoder part to refine the salient regions within all-in-focus image and aggregate the focal stack and all-in-focus image in spatial attention-guided manner. In order to recover more high-frequency details of the obtained salient object map, an implicit detail restoration module is proposed in the decoder part. In virtue of implicit neural representation, we convert the detail restoration problem into a functional mapping problem. By further integrating the self-attention mechanism, the derived saliency map can be depicted at a more refined level. Comprehensive experimental results demonstrate the superiority of the proposed method. Ablation studies and visual comparisons further validate that the proposed method can guarantee the integrality and recover more high-frequency detail information of the obtained saliency map. The code is publicly available at https://github.com/ldyorchid/LFSOD-Net.
引用
收藏
页码:12437 / 12449
页数:13
相关论文
共 50 条
  • [21] Attention and boundary guided salient object detection
    Zhang, Qing
    Shi, Yanjiao
    Zhang, Xueqin
    PATTERN RECOGNITION, 2020, 107 (107)
  • [22] Attention-guided multiscale neural network for defect detection in sewer pipelines
    Li, Yanfen
    Wang, Hanxiang
    Dang, L. Minh
    Song, Hyoung-Kyu
    Moon, Hyeonjoon
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2023, 38 (15) : 2163 - 2179
  • [23] Attention-Guided Multiscale Convolutional Neural Network for Driving Fatigue Detection
    Tang, Jinbu
    Zhou, Wei
    Zheng, Weilong
    Zeng, Zheng
    Li, Jiayi
    Su, Ruizhi
    Adili, Tuheti
    Chen, Wei
    Chen, Chen
    Luo, Jingchun
    IEEE SENSORS JOURNAL, 2024, 24 (14) : 23280 - 23290
  • [24] ARFNet: Attention-Oriented Refinement and Fusion Network for Light Field Salient Object Detection
    Ma, Shuai
    Zhu, Licheng
    Chen, Xianfeng
    Yan, Xu
    Wang, Shuai
    Yang, Ping
    Xu, Bing
    IEEE SYSTEMS JOURNAL, 2022, 16 (04): : 5950 - 5961
  • [25] Attention-guided Feature Fusion for Small Object Detection
    Yang, Jiaxiong
    Liu, Xianhui
    Liu, Zhuang
    IST 2023 - IEEE International Conference on Imaging Systems and Techniques, Proceedings, 2023,
  • [26] Multi-attention guided feature fusion network for salient object detection
    Li, Anni
    Qi, JinQing
    Lu, Huchuan
    NEUROCOMPUTING, 2020, 411 : 416 - 427
  • [27] LFNet: Light Field Fusion Network for Salient Object Detection
    Zhang, Miao
    Ji, Wei
    Piao, Yongri
    Li, Jingjing
    Zhang, Yu
    Xu, Shuang
    Lu, Huchuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6276 - 6287
  • [28] Attention Guided Network for Salient Object Detection in Optical Remote Sensing Images
    Lin, Yuhan
    Sun, Han
    Liu, Ningzhong
    Bian, Yetong
    Cen, Jun
    Zhou, Huiyu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 25 - 36
  • [29] Correction to: CGAN: closure-guided attention network for salient object detection
    Dibyendu Kumar Das
    Sahadeb Shit
    Dip Narayan Ray
    Somajyoti Majumder
    The Visual Computer, 2023, 39 : 5987 - 5987
  • [30] Attention-guided neural network for early dementia detection using MRS data
    Kherchouche, Anouar
    Ben-Ahmed, Olfa
    Guillevin, Carole
    Tremblais, Benoit
    Julian, Adrien
    Fernandez-Maloigne, Christine
    Guillevin, Rémy
    Computerized Medical Imaging and Graphics, 2022, 99