A novel approach with the dynamic decision mechanism (DDM) in multi-focus image fusion

被引:2
|
作者
Aymaz, Samet [1 ]
Kose, Cemal [1 ]
Aymaz, Seyma [1 ]
机构
[1] Karadeniz Tech Univ, Dept Comp Engn, Trabzon, Turkey
关键词
Multi-focus; Image fusion; Deep learning; Focus metrics; CNN; ALGORITHM; TRANSFORM; FRAMEWORK; NETWORKS; WAVELET;
D O I
10.1007/s11042-022-13323-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-focus image fusion merges multiple source images of the same scene with different focus values to obtain a single image that is more informative. A novel approach is proposed to create this single image in this paper. The method's primary stages include creating initial decision maps, applying morphological operations, and obtaining the fused image with the created fusion rule. Initial decision maps consist of label values represented as focused or non-focused. While determining these values, the first decision is made by feeding the image patches obtained from each source image to the modified CNN architecture. If the modified CNN architecture is unstable in determining label values, a new improvement mechanism designed based on focus measurements is applied for unstable regions where each image patch is labelled as non-focused. Then, the initial decision maps obtained for each source image are improved by morphological operations. Finally, the dynamic decision mechanism (DDM) fusion rule, designed considering the label values in the decision maps, is applied to minimize the disinformation resulting from classification errors in the fused image. At the end of all these steps, the final fused image is obtained. Also, in the article, a rich dataset containing two or more than two source images for each scene is created based on the COCO dataset. As a result, the method's success is measured with the help of objective and subjective metrics. When the visual and quantitative results are examined, it is proven that the proposed method successfully creates a perfect fused image.
引用
收藏
页码:1821 / 1871
页数:51
相关论文
共 50 条
  • [31] Multi-focus Image Fusion Using Image Morphology
    Disha, Kakaiya
    Kandoriya, Karshan
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2016, 16 (05): : 118 - 122
  • [32] Novel multi-focus image fusion based on PCNN and random walks
    Zhaobin Wang
    Shuai Wang
    Lijie Guo
    Neural Computing and Applications, 2018, 29 : 1101 - 1114
  • [33] A Novel Multi-focus Image Fusion Based on Lazy Random Walks
    Liu, Wei
    Wang, Zengfu
    IMAGE AND GRAPHICS, ICIG 2019, PT II, 2019, 11902 : 420 - 431
  • [34] Salience preserving multi-focus image fusion
    Hong, Richang
    Wang, Chao
    Ge, Yong
    Wang, Meng
    Wu, Xiuqing
    Zhang, Rong
    2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 1663 - 1666
  • [35] A lightweight scheme for multi-focus image fusion
    Jin, Xin
    Hou, Jingyu
    Nie, Rencan
    Yao, Shaowen
    Zhou, Dongming
    Jiang, Qian
    He, Kangjian
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (18) : 23501 - 23527
  • [37] A novel multi-focus image fusion algorithm based on random walks
    Hua, Kai-Lung
    Wang, Hong-Cyuan
    Rusdi, Aulia Hakim
    Jiang, Shin-Yi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (05) : 951 - 962
  • [38] Spatial Domain Multi-Focus Image Fusion
    Toprak, Ahmet Nusret
    Aslantas, Voysel
    2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [39] Compressive Sensing Multi-focus Image Fusion
    Cheng, Fang
    Yang, Bin
    Huang, Zhiwei
    PATTERN RECOGNITION (CCPR 2014), PT II, 2014, 484 : 107 - 116
  • [40] Multi-focus image fusion in wavelet domain
    Wang, Wei-Wei
    Shui, Peng-Lang
    Song, Guo-Xiang
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2004, 26 (05):