Depth-Distilled Multi-Focus Image Fusion

被引:26
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ]
Lu, Huimin [3 ]
Liu, Yong [4 ]
Yao, Libo [5 ]
Liu, Yu [5 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Kyushu Inst Technol, Kyushu, Japan
[4] Acad Mil Sci, Natl Innovat Inst Def Technol, Beijing 100052, Peoples R China
[5] Naval Aviat Univ, Res Inst informat Fus, Yantai 264001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Feature extraction; Lenses; Task analysis; Testing; Cameras; Adaptation models; Depth distillation; multi-focus image fusion; multi-level decision map fusion; ENHANCEMENT; TRANSFORM; FRAMEWORK; NETWORK;
D O I
10.1109/TMM.2021.3134565
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homogeneous regions, which are smooth areas that lack blur clues to discriminate if they are focused or non-focused. Therefore, they bring a great challenge to achieve high accurate multi-focus image fusion (MFIF). Fortunately, we observe that depth maps are highly related to focus and defocus, containing a preponderance of discriminative power to locate homogeneous regions. This offers the potential to provide additional depth cues to assist MFIF task. Taking depth cues into consideration, in this paper, we propose a new depth-distilled multi-focus image fusion framework, namely D2MFIF. In D2MFIF, depth-distilled model (DDM) is designed for adaptively transferring the depth knowledge into MFIF task, gradually improving MFIF performance. Moreover, multi-level fusion mechanism is designed to integrate multi-level decision maps from intermediate outputs for improving the final prediction. Visually and quantitatively experimental results demonstrate the superiority of our method over several state-of-the-art methods.
引用
收藏
页码:966 / 978
页数:13
相关论文
共 50 条
  • [41] Multi-focus Image Fusion with Cooperative Image Multiscale Decomposition
    Tan, Yueqi
    Yang, Bin
    PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 177 - 188
  • [42] A multi-focus image fusion method based on image features
    Zhou, Lijian
    Ji, Guangrong
    Shi, Changjiang
    Nian, Rut
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 3173 - 3177
  • [43] Single fog image restoration with multi-focus image fusion
    Gao, Yin
    Su, Yijing
    Li, Qiming
    Li, Jun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 55 : 586 - 595
  • [44] Multi-focus image fusion with joint guided image filtering
    Zhang, Yongxin
    Zhao, Peng
    Ma, Youzhong
    Fan, Xunli
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 92
  • [45] Pattern selective image fusion for multi-focus image reconstruction
    Maik, V
    Shin, J
    Paik, J
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PROCEEDINGS, 2005, 3691 : 677 - 684
  • [46] Adversarial attacks on multi-focus image fusion models
    Jin, Xin
    Wang, Ruxin
    Lee, Shin-Jye
    Jiang, Qian
    Yao, Shaowen
    Zhou, Wei
    COMPUTERS & SECURITY, 2023, 134
  • [47] Image fusion: Multi-focus function and its application
    Kimura, Yukinori
    Ichikawa, Akihiko
    Tamura, Tetsuo
    Endo, Ken
    THERMOSENSE XXX, 2008, 6939
  • [48] Multi-Focus Image Fusion Based on NSCT and NSST
    Moonon A.-U.
    Hu J.
    Sensing and Imaging, 2015, 16 (1): : 1 - 16
  • [49] Multi-focus image fusion based on the neighbor distance
    Zhao, Hengjun
    Shang, Zhaowei
    Tang, Yuan Yan
    Fang, Bin
    PATTERN RECOGNITION, 2013, 46 (03) : 1002 - 1011
  • [50] Performance Evaluation of Multi-Focus Image Fusion Techniques
    Madhuri, G.
    Bindu, C. H. Hima
    2015 INTERNATIONAL CONFERENCE ON COMPUTING AND NETWORK COMMUNICATIONS (COCONET), 2015, : 248 - 254