Transformer-CNN-based Multi-feature Aggregation Algorithm for Real Battlefield Image Dehazing

被引:0
|
作者
Wang Y. [1 ]
Tong M. [1 ]
Yan X. [1 ,2 ]
Wei M. [1 ]
机构
[1] College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Jiangsu, Nanjing
[2] Collaborative Innovation Center of Novel Software Technology and Industrialization, Jiangsu, Nanjing
来源
Binggong Xuebao/Acta Armamentarii | 2024年 / 45卷 / 04期
关键词
feature aggregation; image dehazing; military intelligence; semi-supervised network; Transformer-CNN;
D O I
10.12382/bgxb.2022.0957
中图分类号
学科分类号
摘要
The development of military intelligence systems has a great influence on the fighting mode and winning mechanism of modern war. However, these systems are easily affected by haze and other bad weather conditions, resulting in blurred and degraded images, which brings challenges to the subsequent combat missions such as identification and tracking. Therefore, it is essential to restore the haze-free images on the battlefield. Since it is hard to capture the paired clean / hazy images, most existing methods adopt synthetic data for training. However, the gap between the real and synthetic hazy images will lead to the poor generalization of a model trained on synthetic data in the real world. To this end, a Transformer-CNN-based multi-feature aggregation algorithm is proposed for real battlefield image dehazing. This network adopts a semi-supervised framework to train the model with synthetic and real hazy images so that the model can better deal with the real hazy images. The algorithm applies a two-branch feature aggregation architecture to aggregate the local features extracted by CNN branch and the global features extracted by the Transformer branch to further improve the dehazing ability of the model. Moreover, a hazy battlefield image dataset is constructed to simulate the real battlefield hazy conditions. The experimental results show that, compared with 8 state-of-the-art image dehazing algorithms, the proposed algorithm performs well on both synthetic data and real images. © 2024 China Ordnance Industry Corporation. All rights reserved.
引用
收藏
页码:1070 / 1081
页数:11
相关论文
共 31 条
  • [1] LI L, JIN W Q, HUANG Y W, Et al., Real-time image enhancement processing methods of low contrast visible light over-the-horizon imaging, Acta Armamentarii, 31, 2, pp. 242-247, (2010)
  • [2] HE K M, SUN J, TANG X., Single image haze removal using dark channel prior [ J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 12, pp. 2341-2353, (2010)
  • [3] LIU C H, QI Y, DING W R., A haze removal method for unmanned aerial vehicle images based on robust estimation of atmospheric light, Journal of Beijing University of Aeronautics and Astronautics, 43, 6, pp. 1105-1111, (2017)
  • [4] LI C M, JIANG Y T, SONG H P, Et al., Research on optical depth surrogate model-based method for estimating fog density and removing fog effect from images, Acta Armamentarii, 40, 7, pp. 1425-1433, (2019)
  • [5] YANG Y, QIU G Y, HUANG S Y, Et al., Single image dehazing method based on improved atmospheric scattering model, Journal of Beijing University of Aeronautics and Astronautics, 48, 8, pp. 1364-1375, (2022)
  • [6] JIANG Y T, SONG H P, WANG G H., Image dehazing based on the optimum of UAV aerial image quality evaluation, Acta Armamentarii, 43, 1, pp. 148-158, (2022)
  • [7] LI B Y, PENG X L, WANG Z Y, Et al., Aod-net: All-in-one dehazing network [ C ], Proceedings of the IEEE International Conference on Computer Vision, pp. 4770-4778, (2017)
  • [8] CHEN D D, HE M M, FAN Q N, Et al., Gated context aggregation network for image dehazing and deraining, Proceedings of the IEEE Winter Conference on Applications of Computer Vision, pp. 1375-1383, (2019)
  • [9] QIN X, WANG Z L, BAI Y C, Et al., FFA-Net: feature fusion attention network for single image dehazing, Proceedings of the AAAI Conference on Artificial Intelligence, 34, 7, pp. 11908-11915, (2020)
  • [10] BAI H R, PAN J S, XIANG X G, Et al., Self-guided image dehazing using progressive feature fusion, IEEE Transactions on Image Processing, 31, pp. 1217-1229, (2022)