Depth-Distilled Multi-Focus Image Fusion

被引:26
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ]
Lu, Huimin [3 ]
Liu, Yong [4 ]
Yao, Libo [5 ]
Liu, Yu [5 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Kyushu Inst Technol, Kyushu, Japan
[4] Acad Mil Sci, Natl Innovat Inst Def Technol, Beijing 100052, Peoples R China
[5] Naval Aviat Univ, Res Inst informat Fus, Yantai 264001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Feature extraction; Lenses; Task analysis; Testing; Cameras; Adaptation models; Depth distillation; multi-focus image fusion; multi-level decision map fusion; ENHANCEMENT; TRANSFORM; FRAMEWORK; NETWORK;
D O I
10.1109/TMM.2021.3134565
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homogeneous regions, which are smooth areas that lack blur clues to discriminate if they are focused or non-focused. Therefore, they bring a great challenge to achieve high accurate multi-focus image fusion (MFIF). Fortunately, we observe that depth maps are highly related to focus and defocus, containing a preponderance of discriminative power to locate homogeneous regions. This offers the potential to provide additional depth cues to assist MFIF task. Taking depth cues into consideration, in this paper, we propose a new depth-distilled multi-focus image fusion framework, namely D2MFIF. In D2MFIF, depth-distilled model (DDM) is designed for adaptively transferring the depth knowledge into MFIF task, gradually improving MFIF performance. Moreover, multi-level fusion mechanism is designed to integrate multi-level decision maps from intermediate outputs for improving the final prediction. Visually and quantitatively experimental results demonstrate the superiority of our method over several state-of-the-art methods.
引用
收藏
页码:966 / 978
页数:13
相关论文
共 50 条
  • [1] A Multi-Focus Image Fusion Algorithm Based on Depth Learning
    Chen Qingjiang
    Li Yi
    Chai Yuzhou
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (07)
  • [2] Multi-focus image fusion based on depth estimation in HSV space
    Kuang, Tingna
    Zhou, Haiyang
    Yu, Feihong
    AOPC 2020: OPTICAL SENSING AND IMAGING TECHNOLOGY, 2020, 11567
  • [3] DDFN: a depth-differential fusion network for multi-focus image
    Limai Jiang
    Hui Fan
    Jinjiang Li
    Multimedia Tools and Applications, 2022, 81 : 43013 - 43036
  • [4] DDFN: a depth-differential fusion network for multi-focus image
    Jiang, Limai
    Fan, Hui
    Li, Jinjiang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) : 43013 - 43036
  • [5] Multi-focus image fusion based on transformer and depth information learning
    Shao, Xinfeng
    Jin, Xin
    Jiang, Qian
    Miao, Shengfa
    Wang, Puming
    Chu, Xing
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 119
  • [6] Image registration for multi-focus image fusion
    Zhang, Z
    Blum, RS
    BATTLESPACE DIGITIZATION AND NETWORK-CENTRIC WARFARE, 2001, 4396 : 279 - 290
  • [7] Improved Multi-Focus Image Fusion
    Jameel, Amina
    Noor, Fouzia
    2015 18TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2015, : 1346 - 1352
  • [8] A Multi-focus Image Fusion Classifier
    Siddiqui, Abdul Basit
    Rashid, Muhammad
    Jaffar, M. Arfan
    Hussain, Ayyaz
    Mirza, Anwar M.
    INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 2012, 15 (04): : 1757 - 1764
  • [9] Multi-focus thermal image fusion
    Benes, Radek
    Dvorak, Pavel
    Faundez-Zanuy, Marcos
    Espinosa-Duro, Virginia
    Mekyska, Jiri
    PATTERN RECOGNITION LETTERS, 2013, 34 (05) : 536 - 544
  • [10] The automatic focus segmentation of multi-focus image fusion
    Hawari, K.
    Ismail
    BULLETIN OF THE POLISH ACADEMY OF SCIENCES-TECHNICAL SCIENCES, 2022, 70 (01)