Multi-focus image fusion with dense SIFT

被引:347
|
作者
Liu, Yu [1 ]
Liu, Shuping [1 ]
Wang, Zengfu [1 ,2 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei 230026, Peoples R China
[2] Chinese Acad Sci, Inst Intelligent Machines, Hefei 230031, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-focus image fusion; Dense SIFT; Feature space transform; Activity level measurement; Local feature matching; INFORMATION MEASURE; QUALITY ASSESSMENT; PERFORMANCE; SCHEMES;
D O I
10.1016/j.inffus.2014.05.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-focus Image fusion technique is an important approach to obtain a composite image with all objects in focus. The key point of multi-focus image fusion is to develop an effective activity level measurement to evaluate the clarity of source images. This paper proposes a novel image fusion method for multi-focus images with dense scale invariant feature transform (SIFT). The main novelty of this work is that it shows the great potential of image local features such as the dense SIFT used for image fusion. Particularly, the local feature descriptor can not only be employed as the activity level measurement, but also be used to match the mis-registered pixels between multiple source images to improve the quality of the fused image. In our algorithm, via the sliding window technique, the dense SIFT descriptor is first used to measure the activity level of source image patches to obtain an initial decision map, and then the decision map is refined with feature matching and local focus measure comparison. Experimental results demonstrate that the proposed method can be competitive with or even outperform the state-of-the-art fusion methods in terms of both subjective visual perception and objective evaluation metrics. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:139 / 155
页数:17
相关论文
共 50 条
  • [1] Dense Multi-focus Fusion Net: A Deep Unsupervised Convolutional Network for Multi-focus Image Fusion
    Mustafa, Hafiz Tayyab
    Liu, Fanghui
    Yang, Jie
    Khan, Zubair
    Huang, Qiao
    [J]. ARTIFICIAL INTELLIGENCEAND SOFT COMPUTING, PT I, 2019, 11508 : 153 - 163
  • [2] MLDNet: Multi-level dense network for multi-focus image fusion
    Mustafa, Hafiz Tayyab
    Zareapoor, Masoumeh
    Yang, Jie
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 85
  • [3] Image registration for multi-focus image fusion
    Zhang, Z
    Blum, RS
    [J]. BATTLESPACE DIGITIZATION AND NETWORK-CENTRIC WARFARE, 2001, 4396 : 279 - 290
  • [4] Improved Multi-Focus Image Fusion
    Jameel, Amina
    Noor, Fouzia
    [J]. 2015 18TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2015, : 1346 - 1352
  • [5] A Multi-focus Image Fusion Classifier
    Siddiqui, Abdul Basit
    Rashid, Muhammad
    Jaffar, M. Arfan
    Hussain, Ayyaz
    Mirza, Anwar M.
    [J]. INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 2012, 15 (04): : 1757 - 1764
  • [6] Multi-focus thermal image fusion
    Benes, Radek
    Dvorak, Pavel
    Faundez-Zanuy, Marcos
    Espinosa-Duro, Virginia
    Mekyska, Jiri
    [J]. PATTERN RECOGNITION LETTERS, 2013, 34 (05) : 536 - 544
  • [7] Pyramid Pooling Dense Convolutional Neural Network for Multi-focus image Fusion
    Li, Yi
    Shen, Xuanjing
    Chen, Haipeng
    [J]. PROCEEDINGS OF 2019 6TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2019, : 164 - 168
  • [8] The automatic focus segmentation of multi-focus image fusion
    Hawari, K.
    Ismail
    [J]. BULLETIN OF THE POLISH ACADEMY OF SCIENCES-TECHNICAL SCIENCES, 2022, 70 (01)
  • [9] Multi-image transformer for multi-focus image fusion
    Karacan, Levent
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 119
  • [10] Evaluation of focus measures in multi-focus image fusion
    Huang, Wei
    Jing, Zhongliang
    [J]. PATTERN RECOGNITION LETTERS, 2007, 28 (04) : 493 - 500