Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation

被引:2
|
作者
Zheng, Xin [1 ]
Li, Zhengqu [1 ]
Liu, Deyang [1 ]
Zhou, Xiaofei [2 ]
Shan, Caifeng [3 ,4 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing 246000, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310061, Peoples R China
[3] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[4] Nanjing Univ, Sch Intelligence Sci & Technol, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image restoration; Three-dimensional displays; Object detection; Light fields; Fuses; Light field; salient object detection; implicit neural representation; spatial attention; DEPTH ESTIMATION;
D O I
10.1109/TCSVT.2024.3437685
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, many Light Field Salient Object Detection (LF SOD) methods have been proposed. However, guaranteeing the integrality and recovering more high-frequency details of the generated salient object map still remain challenging. To this end, we propose a spatial attention-guided LF SOD network with implicit neural representation to further improve LF SOD performance. We adopt an encoder-decoder structure for model construction. In order to ensure the completeness of the generated salient object map, a multi-modal and multi-scale feature fusion module is designed in the encoder part to refine the salient regions within all-in-focus image and aggregate the focal stack and all-in-focus image in spatial attention-guided manner. In order to recover more high-frequency details of the obtained salient object map, an implicit detail restoration module is proposed in the decoder part. In virtue of implicit neural representation, we convert the detail restoration problem into a functional mapping problem. By further integrating the self-attention mechanism, the derived saliency map can be depicted at a more refined level. Comprehensive experimental results demonstrate the superiority of the proposed method. Ablation studies and visual comparisons further validate that the proposed method can guarantee the integrality and recover more high-frequency detail information of the obtained saliency map. The code is publicly available at https://github.com/ldyorchid/LFSOD-Net.
引用
收藏
页码:12437 / 12449
页数:13
相关论文
共 50 条
  • [41] A foreground-context dual-guided network for light-field salient object detection
    Zheng, Xin
    Wang, Boyang
    Liu, Deyang
    Lv, Chengtao
    Yan, Jiebin
    An, Ping
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2024, 128
  • [42] Attention-Guided Disentangled Feature Aggregation for Video Object Detection
    Muralidhara, Shishir
    Hashmi, Khurram Azeem
    Pagani, Alain
    Liwicki, Marcus
    Stricker, Didier
    Afzal, Muhammad Zeshan
    SENSORS, 2022, 22 (21)
  • [43] Superpixel attention guided network for accurate and real-time salient object detection
    Zhou, Zhiheng
    Guo, Yongfan
    Huang, Junchu
    Dai, Ming
    Deng, Ming
    Yu, Qingjun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (27) : 38921 - 38944
  • [44] Oscillatory model of attention-guided object selection and novelty detection
    Borisyuk, RA
    Kazanovich, YB
    NEURAL NETWORKS, 2004, 17 (07) : 899 - 915
  • [45] Dual guidance enhanced network for light field salient object detection
    Liang, Yanhua
    Qin, Guihe
    Sun, Minghui
    Qin, Jun
    Yan, Jie
    Zhang, Zhonghan
    IMAGE AND VISION COMPUTING, 2022, 118
  • [46] Superpixel attention guided network for accurate and real-time salient object detection
    Zhiheng Zhou
    Yongfan Guo
    Junchu Huang
    Ming Dai
    Ming Deng
    Qingjun Yu
    Multimedia Tools and Applications, 2022, 81 : 38921 - 38944
  • [47] Parallax-Aware Network for Light Field Salient Object Detection
    Yuan, Bo
    Jiang, Yao
    Fu, Keren
    Zhao, Qijun
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 810 - 814
  • [48] Dual guidance enhanced network for light field salient object detection
    Liang, Yanhua
    Qin, Guihe
    Sun, Minghui
    Qin, Jun
    Yan, Jie
    Zhang, Zhonghan
    Image and Vision Computing, 2022, 118
  • [49] Parallax-Aware Network for Light Field Salient Object Detection
    Yuan, Bo
    Jiang, Yao
    Fu, Keren
    Zhao, Qijun
    IEEE Signal Processing Letters, 2024, 31 : 810 - 814
  • [50] Attention-Guided Region Proposal Network for Pedestrian Detection
    Sun, Rui
    Wang, Huihui
    Zhang, Jun
    Zhang, Xudong
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (10) : 2072 - 2076