Polarization Image Super-resolution Reconstruction Based on Dual Attention Residual Network

被引:0
|
作者
Xu Guoming [1 ,2 ,3 ]
Wang Jie [1 ]
Ma Jian [1 ,2 ]
Wang Yong [3 ]
Liu Jiaqing [1 ]
Li Yi [4 ]
机构
[1] Anhui Univ, Sch Internet, Hefei 230039, Peoples R China
[2] Anhui Univ, Natl Engn Res Ctr Agroecol Big Data Anal & Applic, Hefei 230601, Peoples R China
[3] Army Artillery & Air Def Forces Acad PLA, Anhui Prov Key Lab Polarized Imaging Detecting Te, Hefei 230031, Peoples R China
[4] Anhui Wenda Univ Informat Engn, Inst Intelligent Technol, Hefei 231201, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational imaging; Super-resolution; Depth residual network; Polarization images; Dual attention block;
D O I
10.3788/gzxb20225104.0410001
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
In polarization imaging detection, the difference and change of physical properties of aerosols or detection targets are reflected by polarization characteristics. The high-dimensional polarization characteristics effectively improve the contrast between the target and the background, thereby laying the foundation for realizing the inversion of the target's spatial structure. This feature can enhance the recognition effect of the target in the cluttered background. Affected by the imaging distance and atmospheric interference, the limit resolution of the image projected on the focal plane is greatly reduced (much smaller than the optical system diffraction limit resolution), resulting in a lower spatial resolution of the polarized image. On the other hand, the spatial resolution of the polarized image is limited by the number of detector pixel. High resolution images are of great significance and value to the accuracy of target detection. For this reason, without replacing the hardware imaging system, the super-resolution reconstruction method is usually adopted. This method is a common technical means in image processing and practical engineering applications, and it is also a hot research issue of underlying computer vision. The existing image super-resolution algorithms have some problems, such as low utilization of feature information, large amount of parameters, blurred image reconstruction details and so on. The input features of low-resolution images contain rich low-frequency information, which is treated equally in different channels. In computational imaging process using deep learning, image mapping function solution space is very large, it is difficult to generate detailed texture and high-frequency information lack, which hinders convolutional neural network representation ability in image super-resolution. In order to solve this problem, a depth residual polarization image super-resolution network combined with double attention mechanism is proposed. This paper proposes a dual attention residual network model. The network structure is composed of a residual network with a global jump connection, which realizes the connection between the bottom network and the top network to stabilize the training of the deep network. The residual network contains 10 residual groups, and each residual group contains 20 residual blocks cascaded by dual attention blocks with local skip connections; At the same time, considering the interdependence between channels, an adaptive channel feature adjustment mechanism is designed. The channel attention mechanism is regarded as a guide, which biases the allocation of available processing resources towards the most informative part of the input; Cascaded spatial attention blocks are introduced to focus residuals characteristics on the key spatial contents. Spatial attention function measures the correlation between target features and key features, obtains the attention weight, and then aggregates the key content adaptively. The up-sampling module at the end of the network uses sub-pixel convolutional layers to reconstruct high-resolution images. The experiments mainly consist of two parts: first, use the bicubic degradation model to down-sample the training data set collected by the polarization camera, then add noise and blur to obtain the corresponding low-resolution image, and complete the training of the network model. The proposed method is compared with Bicubic, SRCNN, FSRCNN, EDSR methods to verify the effectiveness of the algorithm. In addition, the image reconstructed by this method is compared with the imaging system to provide data reference for system calibration and correction. The experimental results show that the reconstructed image with this method has richer texture details and uniform brightness, which is closer to the high-definition image of the imaging system. The peak signal-to-noise ratio and structural similarity index of this method are better than other methods, but the amount of parameters is only about 2/5 of that of EDSR. Thus, this method has the advantages of low information redundancy and better reconstruction effect.
引用
收藏
页码:295 / 309
页数:15
相关论文
共 27 条
  • [1] CAO Qizhi, 2016, ACTA PHYS SIN-CH ED, V65, P31
  • [2] Clevert D., 2016, 4 INT C LEARN REPR I
  • [3] Second-order Attention Network for Single Image Super-Resolution
    Dai, Tao
    Cai, Jianrui
    Zhang, Yongbing
    Xia, Shu-Tao
    Zhang, Lei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11057 - 11066
  • [4] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [5] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [6] Robust and Discriminative Labeling for Multi-Label Active Learning Based on Maximum Correntropy Criterion
    Du, Bo
    Wang, Zengmao
    Zhang, Lefei
    Zhang, Liangpei
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) : 1694 - 1707
  • [7] Learning reinforced attentional representation for end-to-end visual tracking
    Gao, Peng
    Zhang, Qiquan
    Wang, Fei
    Xiao, Liyi
    Fujita, Hamido
    Zhang, Yan
    [J]. INFORMATION SCIENCES, 2020, 517 : 52 - 67
  • [8] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [9] On an eigenvalue inequality involving the Hadamard product
    Hiai, Fumio
    Lin, Minghua
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2017, 515 : 313 - 320
  • [10] Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]