A multi-focus image fusion method based on attention mechanism and supervised learning

被引:16
|
作者
Jiang, Limai [1 ]
Fan, Hui [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
[2] Coinnovat Ctr Shandong Coll & Univ Future Intelli, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-focus image fusion; Convolutional neural network; Attention mechanism; FILTER;
D O I
10.1007/s10489-021-02358-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-focus image fusion is always a difficult problem in digital image processing. To achieve efficient integration, we propose a new end-to-end network. This network uses the residual atrous spatial pyramid pooling module to extract multi-level features from the space of different scales and share parameters to ensure the consistency and correspondence of features. We also introduced a disparities attention module for the network which allows for information retention. These two parts can make our method overcome the difficulties of target edge artifacts, small range blur, poor detail capture, and so on. In addition, in order to improve the semantic ambiguity easily caused by unsupervised learning, we also proposed a new multi-focus image fusion dataset with groundtruth for supervised learning. We performed sufficient experiments, and the results show that the network can quickly capture the corresponding features of multi-focus images, and improve the fusion performance with less computation and lower storage cost. Compared with the existing nine fusion methods, our network is superior to other methods in subjective visual evaluation and objective evaluation, reaching a higher level.
引用
收藏
页码:339 / 357
页数:19
相关论文
共 50 条
  • [1] A multi-focus image fusion method based on attention mechanism and supervised learning
    Limai Jiang
    Hui Fan
    Jinjiang Li
    [J]. Applied Intelligence, 2022, 52 : 339 - 357
  • [2] Multi-focus image fusion based on unsupervised learning
    Kaijun Wu
    Yuan Mei
    [J]. Machine Vision and Applications, 2022, 33
  • [3] Multi-focus image fusion based on unsupervised learning
    Wu, Kaijun
    Mei, Yuan
    [J]. MACHINE VISION AND APPLICATIONS, 2022, 33 (05)
  • [4] A multi-focus image fusion method based on image features
    Zhou, Lijian
    Ji, Guangrong
    Shi, Changjiang
    Nian, Rut
    [J]. DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 3173 - 3177
  • [5] A pixel based multi-focus image fusion method
    Aslantas, Veysel
    Toprak, Ahmet Nusret
    [J]. OPTICS COMMUNICATIONS, 2014, 332 : 350 - 358
  • [6] Multi-Focus Image Fusion Algorithm Based on Supervised Learning for Fully Convolutional Neural Networks
    Li Heng
    Zhang Liming
    Jiang Meirong
    Li Yulong
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (08)
  • [7] Multi-focus image fusion algorithm based on supervised learning for fully convolutional neural network
    Li, Heng
    Zhang, Liming
    Jiang, Meirong
    Li, Yulong
    [J]. PATTERN RECOGNITION LETTERS, 2021, 141 : 45 - 53
  • [8] Fusion PSPnet Image Segmentation Based Method for Multi-Focus Image Fusion
    Zhou, Jingchun
    Hao, Mingliang
    Zhang, Dehuan
    Zou, Peiyu
    Zhang, Weishi
    [J]. IEEE PHOTONICS JOURNAL, 2019, 11 (06):
  • [9] Attention based dual path fusion networks for multi-focus image
    Nana Yu
    Jinjiang Li
    Zhen Hua
    [J]. Multimedia Tools and Applications, 2022, 81 : 10883 - 10906
  • [10] Color multi-focus image fusion based on transfer learning
    Wang, Yun
    Jin, Xin
    Yang, Jie
    Jiang, Qian
    Tang, Yue
    Wang, Puming
    Lee, Shin-Jye
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (03) : 2083 - 2102