Transformer-CNN-based Multi-feature Aggregation Algorithm for Real Battlefield Image Dehazing

被引:0
|
作者
Wang Y. [1 ]
Tong M. [1 ]
Yan X. [1 ,2 ]
Wei M. [1 ]
机构
[1] College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Jiangsu, Nanjing
[2] Collaborative Innovation Center of Novel Software Technology and Industrialization, Jiangsu, Nanjing
来源
Binggong Xuebao/Acta Armamentarii | 2024年 / 45卷 / 04期
关键词
feature aggregation; image dehazing; military intelligence; semi-supervised network; Transformer-CNN;
D O I
10.12382/bgxb.2022.0957
中图分类号
学科分类号
摘要
The development of military intelligence systems has a great influence on the fighting mode and winning mechanism of modern war. However, these systems are easily affected by haze and other bad weather conditions, resulting in blurred and degraded images, which brings challenges to the subsequent combat missions such as identification and tracking. Therefore, it is essential to restore the haze-free images on the battlefield. Since it is hard to capture the paired clean / hazy images, most existing methods adopt synthetic data for training. However, the gap between the real and synthetic hazy images will lead to the poor generalization of a model trained on synthetic data in the real world. To this end, a Transformer-CNN-based multi-feature aggregation algorithm is proposed for real battlefield image dehazing. This network adopts a semi-supervised framework to train the model with synthetic and real hazy images so that the model can better deal with the real hazy images. The algorithm applies a two-branch feature aggregation architecture to aggregate the local features extracted by CNN branch and the global features extracted by the Transformer branch to further improve the dehazing ability of the model. Moreover, a hazy battlefield image dataset is constructed to simulate the real battlefield hazy conditions. The experimental results show that, compared with 8 state-of-the-art image dehazing algorithms, the proposed algorithm performs well on both synthetic data and real images. © 2024 China Ordnance Industry Corporation. All rights reserved.
引用
收藏
页码:1070 / 1081
页数:11
相关论文
共 31 条
  • [21] MITTAL A, SOUNDARARAJAN R, BOVIK A C., Making a 野 completely blind 冶 image quality analyzer [ J ], IEEE Signal Processing Letters, 20, 3, pp. 209-212, (2012)
  • [22] CHOI L K, YOU J, BOVIK A C., Referenceless prediction of perceptual fog density and perceptual image defogging, IEEE Transactions on Image Processing, 24, 11, pp. 3888-3901, (2015)
  • [23] LI B Y, REN W Q, FU D P, Et al., Benchmarking single-image dehazing and beyond [ J ], IEEE Transactions on Image Processing, 28, 1, pp. 492-505, (2018)
  • [24] ULLAH H, MUHAMMAD K, IRFAN M, Et al., Light-DehazeNet: a novel lightweight CNN architecture for single image dehazing, IEEE Transactions on Image Processing, 30, pp. 8968-8982, (2021)
  • [25] LI B Y, GOU Y B, GU S H, Et al., You only look yourself: unsupervised and untrained single image dehazing neural network, International Journal of Computer Vision, 129, 5, pp. 1754-1767, (2021)
  • [26] CHEN Z Y, WANG Y C, YANG Y, Et al., PSD: principled synthetic-to-real dehazing guided by physical priors [ C ], Proceedings of the IEEE / CVF International Conference on Computer Vision, pp. 7180-7189, (2021)
  • [27] WANY Z, BOVIK A C, SHEIKH H R, Et al., Image quality assessment: from error visibility to structural similarity, IEEE Transactions on Image Processing, 13, 4, pp. 600-612, (2004)
  • [28] SHARMA G, WU W C, DALAL E N., The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations, Color Research & Application, 30, 1, pp. 21-30, (2005)
  • [29] MITTAL A, MOORTHY A K, BOVIK A C., No-reference image quality assessment in the spatial domain, IEEE Transactions on image processing, 21, 12, pp. 4695-4708, (2012)
  • [30] CHEN Z Y, JIANG T T, TIAN Y H., Quality assessment for comparing image enhancement algorithms [ C], Proceedings of the IEEE International Conference on Computer Vision, pp. 3003-3010, (2014)