A Method of Single-Image Light Source Interference Removal Based on the Multitask Network

被引:0
|
作者
Zhang W. [1 ]
Cheng G. [1 ]
机构
[1] School of Microelectronics, Tianjin University, Tianjin
来源
Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology | 2024年 / 57卷 / 05期
关键词
deep learning; flare removal; image processing;
D O I
10.11784/tdxbz202302023
中图分类号
学科分类号
摘要
In the presence of light sources at a scene,captured images may be easily interfered with by the existence of various kinds of flares,glares,artifacts,etc. This leads to a lowered quality of key information,which adversely affects vision-based tasks such as object detection,depth estimation,and semantic segmentation based on those images. However,removing the light source interference of various forms and distributions with current methods is difficult. Therefore,we propose a light source interference removal network and its training method to solve issues regarding poor processing results,lack of paired training data,and weak generalization of existing algorithms. This network combines a multitasking structure to fully utilize the feature information of different tasks and thereby improves its interference removal performance. In addition,a postprocessing method for light source blend is presented to reduce the interference introduced in the postprocessing step. The proposed method realizes an average peak signal-to-noise ratio of 25.81 dB and 23.25 dB and a structural similarity of 0.872 6 and 0.922 3 when using public and self-built datasets,respectively. In terms of subjective qualitative comparison,the proposed method has better interference removal performance compared to existing methods. © 2024 Tianjin University. All rights reserved.
引用
收藏
页码:501 / 510
页数:9
相关论文
共 28 条
  • [1] Boynton P A, Kelley E F., Liquid-filled camera for the measurement of high-contrast images[C], AeroSense 2003, pp. 370-378, (2003)
  • [2] Xi Chen, Mobile phone camera lens design with reduced flare[C], International Optical Design Conference, (2010)
  • [3] Talvala E V,, Adams A,, Horowitz M,, Et al., Veiling glare in high dynamic range imaging[J], ACM Transactions on Graphics, 26, 3, pp. 1-9, (2007)
  • [4] Raskar R,, Agrawal A,, Wilson C A, Et al., Glare aware photography:4d ray sampling for reducing glare effects of camera lenses[C], Special Interest Group on Computer Graphics and Interactive Techniques Conference, pp. 1-10, (2008)
  • [5] Schechner Y Y., Geometry by deflaring [C], IEEE International Conference on Computational Photography(ICCP), pp. 1-8, (2009)
  • [6] High Dynamic Range Imaging : Acquisition , Display , and Image-Based Lighting[M], (2005)
  • [7] Faulkner K, Kotre C J, Louka M., Veiling glare deconvolution of images produced by X-ray image intensifiers[C], International Conference on Image Processing & Its Applications, pp. 669-673, (1989)
  • [8] Asha C S,, Bhat S K,, Nayak D,, Et al., Auto removal of bright spot from images captured against flashing light source[C], 2019 IEEE International Conference on Distributed Computing,VLSI,Electrical Circuits and Robotics(DISCOVER), pp. 1-6, (2019)
  • [9] Wu Y C,, He Q R,, Xue T F, Et al., How to train neural networks for flare removal[C], 2021 IEEE/CVF International Conference on Computer Vision, pp. 2219-2227, (2021)
  • [10] Ye S, Yin J L, Et al., Single image glare removal using deep convolutional networks[C], 2020 IEEE International Conference on Image Processing (ICIP), pp. 201-205, (2020)