Depth-Distilled Multi-Focus Image Fusion

被引:26
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ]
Lu, Huimin [3 ]
Liu, Yong [4 ]
Yao, Libo [5 ]
Liu, Yu [5 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Kyushu Inst Technol, Kyushu, Japan
[4] Acad Mil Sci, Natl Innovat Inst Def Technol, Beijing 100052, Peoples R China
[5] Naval Aviat Univ, Res Inst informat Fus, Yantai 264001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Feature extraction; Lenses; Task analysis; Testing; Cameras; Adaptation models; Depth distillation; multi-focus image fusion; multi-level decision map fusion; ENHANCEMENT; TRANSFORM; FRAMEWORK; NETWORK;
D O I
10.1109/TMM.2021.3134565
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homogeneous regions, which are smooth areas that lack blur clues to discriminate if they are focused or non-focused. Therefore, they bring a great challenge to achieve high accurate multi-focus image fusion (MFIF). Fortunately, we observe that depth maps are highly related to focus and defocus, containing a preponderance of discriminative power to locate homogeneous regions. This offers the potential to provide additional depth cues to assist MFIF task. Taking depth cues into consideration, in this paper, we propose a new depth-distilled multi-focus image fusion framework, namely D2MFIF. In D2MFIF, depth-distilled model (DDM) is designed for adaptively transferring the depth knowledge into MFIF task, gradually improving MFIF performance. Moreover, multi-level fusion mechanism is designed to integrate multi-level decision maps from intermediate outputs for improving the final prediction. Visually and quantitatively experimental results demonstrate the superiority of our method over several state-of-the-art methods.
引用
收藏
页码:966 / 978
页数:13
相关论文
共 50 条
  • [31] A Novel Fusion Algorithm for Multi-focus Image
    Wang Hongmei
    Nie Cong
    Li Yanjun
    Zhang Ke
    Chen Lihua
    2010 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION (PACIIA2010), VOL IV, 2010, : 396 - 399
  • [32] Exploiting Superpixels for Multi-Focus Image Fusion
    Ilyas, Areeba
    Farid, Muhammad Shahid
    Khan, Muhammad Hassan
    Grzegorzek, Marcin
    ENTROPY, 2021, 23 (02) : 1 - 22
  • [33] A Survey of Multi-Focus Image Fusion Methods
    Zhou, Youyong
    Yu, Lingjie
    Zhi, Chao
    Huang, Chuwen
    Wang, Shuai
    Zhu, Mengqiu
    Ke, Zhenxia
    Gao, Zhongyuan
    Zhang, Yuming
    Fu, Sida
    APPLIED SCIENCES-BASEL, 2022, 12 (12):
  • [34] Multi-focus image fusion techniques: a survey
    Bhat, Shiveta
    Koundal, Deepika
    ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (08) : 5735 - 5787
  • [35] Multi-focus image fusion with dense SIFT
    Liu, Yu
    Liu, Shuping
    Wang, Zengfu
    INFORMATION FUSION, 2015, 23 : 139 - 155
  • [36] A Novel Fusion Algorithm for Multi-focus Image
    Wang Hongmei
    Nie Cong
    Li Yanjun
    Zhang Ke
    Chen Lihua
    APPLIED INFORMATICS AND COMMUNICATION, PT 4, 2011, 227 : 641 - +
  • [37] Methods of Depth Measurement and Image Fusion Based on Multi-focus Micro-images
    Yin Ying-jie
    Wang Xin-gang
    Xu De
    Zhang Zheng-tao
    Bai Ming-ran
    Shi Gang
    2013 25TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2013, : 3776 - 3779
  • [38] Reconstruction Algorithm of Iris Image with Great Depth of Field Based on Multi-focus Fusion
    Gong, Yazhuo
    Shi, Pengfei
    INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION, VOL 2, PROCEEDINGS, 2008, : 165 - +
  • [39] Focus Relationship Perception for Unsupervised Multi-Focus Image Fusion
    Liu, Jinyang
    Li, Shutao
    Dian, Renwei
    Song, Ze
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6155 - 6165
  • [40] All-Focus Image Fusion and Depth Image Estimation Based on Iterative Splitting Technique for Multi-focus Images
    Lie, Wen-Nung
    Ho, Chia-Che
    IMAGE AND VIDEO TECHNOLOGY, PSIVT 2015, 2016, 9431 : 594 - 604