Multi-Exposure Image Fusion via Multi-Scale and Context-Aware Feature Learning

被引:3
|
作者
Liu, Yu [1 ,2 ]
Yang, Zhigang [1 ,2 ]
Cheng, Juan [1 ,2 ]
Chen, Xun [3 ]
机构
[1] Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Image fusion; Decoding; Transforms; Transformers; Visualization; Auto-encoder; global contextual information; multi-exposure image fusion; multi-scale features; Transformer; QUALITY ASSESSMENT;
D O I
10.1109/LSP.2023.3243767
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this letter, a deep learning (DL)-based multi-exposure image fusion (MEF) method via multi-scale and context-aware feature learning is proposed, aiming to overcome the defects of existing traditional and DL-based methods. The proposed network is based on an auto-encoder architecture. First, an encoder that combines the convolutional network and Transformer is designed to extract multi-scale features and capture the global contextual information. Then, a multi-scale feature interaction (MSFI) module is devised to enrich the scale diversity of extracted features using cross-scale fusion and Atrous spatial pyramid pooling (ASPP). Finally, a decoder with a nest connection architecture is introduced to reconstruct the fused image. Experimental results show that the proposed method outperforms several representative traditional and DL-based MEF methods in terms of both visual quality and objective assessment.
引用
收藏
页码:100 / 104
页数:5
相关论文
共 50 条
  • [1] Fast Multi-Scale Structural Patch Decomposition for Multi-Exposure Image Fusion
    Li, Hui
    Ma, Kede
    Yong, Hongwei
    Zhang, Lei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5805 - 5816
  • [2] A multi-scale patch-wise algorithm for multi-exposure image fusion
    Jia, Jinquan
    Sun, Jian
    Zhu, Zhiqin
    [J]. OPTIK, 2021, 248
  • [3] Multi-scale Fusion with Context-aware Network for Object Detection
    Wang, Hanyuan
    Xu, Jie
    Li, Linke
    Tian, Ye
    Xu, Du
    Xu, Shizhong
    [J]. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 2486 - 2491
  • [4] An ultra-high-definition multi-exposure image fusion method based on multi-scale feature extraction
    Jia, Xiuyi
    Lin, Qiaowanni
    Ding, Weiping
    [J]. APPLIED SOFT COMPUTING, 2024, 166
  • [5] LGABL: UHD Multi-Exposure Image Fusion via Local and Global Aware Bilateral Learning
    Wang, Di
    Zheng, Zhuoran
    Ding, Weiping
    Jia, Xiuyi
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1362 - 1375
  • [6] A multi-scale contrast-based image quality assessment model for multi-exposure image fusion
    Xing, Lu
    Cai, Lei
    Zeng, Huanqiang
    Chen, Jing
    Zhu, Jianqing
    Hou, Junhui
    [J]. SIGNAL PROCESSING, 2018, 145 : 233 - 240
  • [7] Multi-Exposure Image Fusion Through Feature Decomposition
    Kim, Jong-Han
    Lee, Kang-Kyu
    Kim, Jong-Ok
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-ASIA (ICCE-ASIA), 2021,
  • [8] Single Image Brightening via Multi-Scale Exposure Fusion With Hybrid Learning
    Zheng, Chaobing
    Li, Zhengguo
    Yang, Yi
    Wu, Shiqian
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (04) : 1425 - 1435
  • [9] CONTEXT-AWARE HIERARCHICAL FEATURE ATTENTION NETWORK FOR MULTI-SCALE OBJECT DETECTION
    Xu, Xuelong
    Luo, Xiangfeng
    Ma, Liyan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2011 - 2015
  • [10] Multi-exposure Image Fusion Based on Sparsity Blur Feature
    Que, Yue
    Wan, Weiguo
    Lee, Hyo Jong
    [J]. 2018 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2018, 10836