A novel approach with the dynamic decision mechanism (DDM) in multi-focus image fusion

被引:2
|
作者
Aymaz, Samet [1 ]
Kose, Cemal [1 ]
Aymaz, Seyma [1 ]
机构
[1] Karadeniz Tech Univ, Dept Comp Engn, Trabzon, Turkey
关键词
Multi-focus; Image fusion; Deep learning; Focus metrics; CNN; ALGORITHM; TRANSFORM; FRAMEWORK; NETWORKS; WAVELET;
D O I
10.1007/s11042-022-13323-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-focus image fusion merges multiple source images of the same scene with different focus values to obtain a single image that is more informative. A novel approach is proposed to create this single image in this paper. The method's primary stages include creating initial decision maps, applying morphological operations, and obtaining the fused image with the created fusion rule. Initial decision maps consist of label values represented as focused or non-focused. While determining these values, the first decision is made by feeding the image patches obtained from each source image to the modified CNN architecture. If the modified CNN architecture is unstable in determining label values, a new improvement mechanism designed based on focus measurements is applied for unstable regions where each image patch is labelled as non-focused. Then, the initial decision maps obtained for each source image are improved by morphological operations. Finally, the dynamic decision mechanism (DDM) fusion rule, designed considering the label values in the decision maps, is applied to minimize the disinformation resulting from classification errors in the fused image. At the end of all these steps, the final fused image is obtained. Also, in the article, a rich dataset containing two or more than two source images for each scene is created based on the COCO dataset. As a result, the method's success is measured with the help of objective and subjective metrics. When the visual and quantitative results are examined, it is proven that the proposed method successfully creates a perfect fused image.
引用
收藏
页码:1821 / 1871
页数:51
相关论文
共 50 条
  • [21] A Novel DWT Based Multi-focus Image Fusion Method
    Yang, Yong
    INTERNATIONAL CONFERENCE ON ADVANCES IN ENGINEERING 2011, 2011, 24 : 177 - 181
  • [22] A Novel Weight Fusion Approach for Multi-focus Image Based on NSST Transform Domain
    Wang, Feng
    Cheng, Yongmei
    2016 IEEE CHINESE GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2016, : 2250 - 2254
  • [23] An Efficient Multi-focus Image Fusion Approach Based on DWT
    Sonam
    Kumar, Manoj
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON SIGNAL, NETWORKS, COMPUTING, AND SYSTEMS (ICSNCS 2016), VOL 1, 2017, 395 : 45 - 52
  • [24] Multi-Focus Image Fusion Based on Decision Map and Sparse Representation
    Liao, Bin
    Chen, Hua
    Mo, Wei
    APPLIED SCIENCES-BASEL, 2019, 9 (17):
  • [25] The automatic focus segmentation of multi-focus image fusion
    Hawari, K.
    Ismail
    BULLETIN OF THE POLISH ACADEMY OF SCIENCES-TECHNICAL SCIENCES, 2022, 70 (01)
  • [26] Multi-focus image fusion framework based on transformer and feedback mechanism
    Wang, Xuejiao
    Hua, Zhen
    Li, Jinjiang
    AIN SHAMS ENGINEERING JOURNAL, 2023, 14 (05)
  • [27] Multi-image transformer for multi-focus image fusion
    Karacan, Levent
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 119
  • [28] Multi-focus Image Fusion Using Gaussian Filter and Dynamic Programming
    Liu, Shumin
    Zhang, Jiaxuan
    Chen, Jiajia
    2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017), 2017, : 1182 - 1185
  • [29] Evaluation of focus measures in multi-focus image fusion
    Huang, Wei
    Jing, Zhongliang
    PATTERN RECOGNITION LETTERS, 2007, 28 (04) : 493 - 500
  • [30] Dense Multi-focus Fusion Net: A Deep Unsupervised Convolutional Network for Multi-focus Image Fusion
    Mustafa, Hafiz Tayyab
    Liu, Fanghui
    Yang, Jie
    Khan, Zubair
    Huang, Qiao
    ARTIFICIAL INTELLIGENCEAND SOFT COMPUTING, PT I, 2019, 11508 : 153 - 163