Multi-Exposure Image Fusion via Multi-Scale and Context-Aware Feature Learning

被引:3
|
作者
Liu, Yu [1 ,2 ]
Yang, Zhigang [1 ,2 ]
Cheng, Juan [1 ,2 ]
Chen, Xun [3 ]
机构
[1] Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Image fusion; Decoding; Transforms; Transformers; Visualization; Auto-encoder; global contextual information; multi-exposure image fusion; multi-scale features; Transformer; QUALITY ASSESSMENT;
D O I
10.1109/LSP.2023.3243767
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this letter, a deep learning (DL)-based multi-exposure image fusion (MEF) method via multi-scale and context-aware feature learning is proposed, aiming to overcome the defects of existing traditional and DL-based methods. The proposed network is based on an auto-encoder architecture. First, an encoder that combines the convolutional network and Transformer is designed to extract multi-scale features and capture the global contextual information. Then, a multi-scale feature interaction (MSFI) module is devised to enrich the scale diversity of extracted features using cross-scale fusion and Atrous spatial pyramid pooling (ASPP). Finally, a decoder with a nest connection architecture is introduced to reconstruct the fused image. Experimental results show that the proposed method outperforms several representative traditional and DL-based MEF methods in terms of both visual quality and objective assessment.
引用
收藏
页码:100 / 104
页数:5
相关论文
共 50 条
  • [21] Multi-exposure fusion for welding region based on multi-scale transform and hybrid weight
    Haiyong Chen
    Yafei Ren
    Junqi Cao
    Weipeng Liu
    Kun Liu
    [J]. The International Journal of Advanced Manufacturing Technology, 2019, 101 : 105 - 117
  • [22] Deep Guided Learning for Fast Multi-Exposure Image Fusion
    Ma, Kede
    Duanm, Zhengfang
    Zhu, Hanwei
    Fang, Yuming
    Wang, Zhou
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 2808 - 2819
  • [23] Multi-exposure image fusion based on feature evaluation with adaptive factor
    Huang, Li
    Li, Zhengping
    Xu, Chao
    Feng, Bo
    [J]. IET IMAGE PROCESSING, 2021, 15 (13) : 3211 - 3220
  • [24] Global context-aware feature modulation networks for unified multi-scale super-resolution
    Zhang, Dacheng
    Lei, Weimin
    Zhang, Wei
    Chen, Xinyi
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (03)
  • [25] Progressively Multi-Scale Feature Fusion for Image Inpainting
    Wen, Wu
    Li, Tianhao
    Tolba, Amr
    Liu, Ziyi
    Shao, Kai
    [J]. MATHEMATICS, 2023, 11 (24)
  • [26] Space Plant Image Segmentation via Multi-Scale Deep Feature Fusion
    Cao, Jingkang
    Duan, Jiangyong
    Meng, Juan
    Li, Ye
    [J]. 2018 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (CSSE 2018), 2018, : 12 - 22
  • [27] MULTI-EXPOSURE IMAGE FUSION BASED ON EXPOSURE COMPENSATION
    Kinoshita, Yuma
    Yoshida, Taichi
    Shiota, Sayaka
    Kiya, Hitoshi
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1388 - 1392
  • [28] Medical Image Fusion Based on Multi-Scale Feature Learning and Edge Enhancement
    Xiao Wanxin
    Li Huafeng
    Zhang Yafei
    Xie Minghong
    Li Fan
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (06)
  • [29] Enhancing image visuality by multi-exposure fusion
    Yan, Qingsen
    Zhu, Yu
    Zhou, Yulin
    Sun, Jinqiu
    Zhang, Lei
    Zhang, Yanning
    [J]. PATTERN RECOGNITION LETTERS, 2019, 127 : 66 - 75
  • [30] AUTOMATIC EXPOSURE COMPENSATION FOR MULTI-EXPOSURE IMAGE FUSION
    Kinoshita, Yuma
    Shiota, Sayaka
    Kiya, Hitoshi
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 883 - 887