Recently, many Light Field Salient Object Detection (LF SOD) methods have been proposed. However, guaranteeing the integrality and recovering more high-frequency details of the generated salient object map still remain challenging. To this end, we propose a spatial attention-guided LF SOD network with implicit neural representation to further improve LF SOD performance. We adopt an encoder-decoder structure for model construction. In order to ensure the completeness of the generated salient object map, a multi-modal and multi-scale feature fusion module is designed in the encoder part to refine the salient regions within all-in-focus image and aggregate the focal stack and all-in-focus image in spatial attention-guided manner. In order to recover more high-frequency details of the obtained salient object map, an implicit detail restoration module is proposed in the decoder part. In virtue of implicit neural representation, we convert the detail restoration problem into a functional mapping problem. By further integrating the self-attention mechanism, the derived saliency map can be depicted at a more refined level. Comprehensive experimental results demonstrate the superiority of the proposed method. Ablation studies and visual comparisons further validate that the proposed method can guarantee the integrality and recover more high-frequency detail information of the obtained saliency map. The code is publicly available at https://github.com/ldyorchid/LFSOD-Net.
机构:
South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
South China Univ Technol, Minist Educ, Key Lab Big Data & Intelligent Robot, Guangzhou, Peoples R ChinaSouth China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
Zhou, Zhiheng
Guo, Yongfan
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
South China Univ Technol, Minist Educ, Key Lab Big Data & Intelligent Robot, Guangzhou, Peoples R ChinaSouth China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
Guo, Yongfan
Huang, Junchu
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
South China Univ Technol, Minist Educ, Key Lab Big Data & Intelligent Robot, Guangzhou, Peoples R ChinaSouth China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
Huang, Junchu
Dai, Ming
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
South China Univ Technol, Minist Educ, Key Lab Big Data & Intelligent Robot, Guangzhou, Peoples R ChinaSouth China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
Dai, Ming
Deng, Ming
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
South China Univ Technol, Minist Educ, Key Lab Big Data & Intelligent Robot, Guangzhou, Peoples R ChinaSouth China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
Deng, Ming
Yu, Qingjun
论文数: 0引用数: 0
h-index: 0
机构:
Dalian Neusoft Univ Informat, Sch Digital Arts & Design, Dalian, Peoples R ChinaSouth China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
机构:
College of Computer Science and Technology, Jilin University, Changchun,130012, China
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun,130012, ChinaCollege of Computer Science and Technology, Jilin University, Changchun,130012, China
Liang, Yanhua
Qin, Guihe
论文数: 0引用数: 0
h-index: 0
机构:
College of Computer Science and Technology, Jilin University, Changchun,130012, China
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun,130012, ChinaCollege of Computer Science and Technology, Jilin University, Changchun,130012, China
Qin, Guihe
Sun, Minghui
论文数: 0引用数: 0
h-index: 0
机构:
College of Computer Science and Technology, Jilin University, Changchun,130012, China
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun,130012, ChinaCollege of Computer Science and Technology, Jilin University, Changchun,130012, China
Sun, Minghui
Qin, Jun
论文数: 0引用数: 0
h-index: 0
机构:
School of Computer Science and Technology, Changchun University of Science and Technology, Changchun,130012, ChinaCollege of Computer Science and Technology, Jilin University, Changchun,130012, China
Qin, Jun
Yan, Jie
论文数: 0引用数: 0
h-index: 0
机构:
College of Computer Science and Technology, Jilin University, Changchun,130012, China
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun,130012, ChinaCollege of Computer Science and Technology, Jilin University, Changchun,130012, China
Yan, Jie
Zhang, Zhonghan
论文数: 0引用数: 0
h-index: 0
机构:
College of Computer Science and Technology, Jilin University, Changchun,130012, China
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun,130012, ChinaCollege of Computer Science and Technology, Jilin University, Changchun,130012, China