End-to-End Exposure Fusion Using Convolutional Neural Network

被引:16
|
作者
Wang, Jinhua [1 ,2 ]
Wang, Weiqiang [1 ]
Xu, Guangmei [2 ]
Liu, Hongzhe [3 ]
机构
[1] Univ Chinese Acad Sci, Sch Comp & Control Engn, Beijing 100049, Peoples R China
[2] Beijing Union Univ, Coll Informat Technol, Beijing 100101, Peoples R China
[3] Beijing Key Lab Informat Serv Engn, Beijing, Peoples R China
来源
关键词
exposure fusion; convolutional neural networks; fusion rule; activity level measurement; IMAGES;
D O I
10.1587/transinf.2017EDL8173
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we describe the direct learning of an end-to-end mapping between under-/over-exposed images and well-exposed images. The mapping is represented as a deep convolutional neural network (CNN) that takes multiple-exposure images as input and outputs a high-quality image. Our CNN has a lightweight structure, yet gives state-of-the-art fusion quality. Furthermore, we know that for a given pixel, the influence of the surrounding pixels gradually increases as the distance decreases. If the only pixels considered are those in the convolution kernel neighborhood, the final result will be affected. To overcome this problem, the size of the convolution kernel is often increased. However, this also increases the complexity of the network (too many parameters) and the training time. In this paper, we present a method in which a number of sub-images of the source image are obtained using the same CNN model, providing more neighborhood information for the convolution operation. Experimental results demonstrate that the proposed method achieves better performance in terms of both objective evaluation and visual quality.
引用
收藏
页码:560 / 563
页数:4
相关论文
共 50 条
  • [1] End-to-End PSK Signals Demodulation Using Convolutional Neural Network
    Chen, Wen-Jie
    Wang, Jiao
    Li, Jian-Qing
    [J]. IEEE ACCESS, 2022, 10 : 58302 - 58310
  • [2] End-to-End Musical Key Estimation Using a Convolutional Neural Network
    Korzeniowski, Filip
    Widmer, Gerhard
    [J]. 2017 25TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2017, : 966 - 970
  • [3] End-to-End Multispectral Image Compression Using Convolutional Neural Network
    Kong Fanqiang
    Zhou Yongbo
    Shen Qiu
    Wen Keyao
    [J]. CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2019, 46 (10):
  • [4] Image reflection removal using end-to-end convolutional neural network
    Li, Jinjiang
    Li, Guihui
    Fan, Hui
    [J]. IET IMAGE PROCESSING, 2020, 14 (06) : 1047 - 1058
  • [5] GuidedNet: Single Image Dehazing Using an End-to-end Convolutional Neural Network
    Goncalves, Lucas T.
    Gaya, Joel O.
    Drews-, Paulo, Jr.
    Botelho, Silvia S. C.
    [J]. PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2018, : 79 - 86
  • [6] An End-To-End Seizure Prediction Method Using Convolutional Neural Network and Transformer
    Wang, Yiyuan
    Zhao, Wenshan
    [J]. 12TH ASIAN-PACIFIC CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING, VOL 2, APCMBE 2023, 2024, 104 : 317 - 324
  • [7] End-to-End Navigation with Branch Turning Support using Convolutional Neural Network
    Seiya, Shunya
    Carballo, Alexander
    Takeuchi, Eijiro
    Miyajima, Chiyomi
    Takeda, Kazuya
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 499 - 506
  • [8] LEARNING ENVIRONMENTAL SOUNDS WITH END-TO-END CONVOLUTIONAL NEURAL NETWORK
    Tokozume, Yuji
    Harada, Tatsuya
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2721 - 2725
  • [9] End-to-End Hardware Accelerator for Deep Convolutional Neural Network
    Chang, Tian-Sheuan
    [J]. 2018 INTERNATIONAL SYMPOSIUM ON VLSI DESIGN, AUTOMATION AND TEST (VLSI-DAT), 2018,
  • [10] End-to-end recognition of slab identification numbers using a deep convolutional neural network
    Lee, Sang Jun
    Yun, Jong Pil
    Koo, Gyogwon
    Kim, Sang Woo
    [J]. KNOWLEDGE-BASED SYSTEMS, 2017, 132 : 1 - 10