Recurrent neural network multi-label aerial images classification

被引:0
|
作者
Chen K.-J. [1 ,2 ]
Zhang Y. [1 ]
机构
[1] Changchun Institute of Optics Fine Mechanics and Physics, Chinese Academy of Sciences, State Key Laboratory of Applied Optics, Changchun
[2] Chinese Academy of Sciences, Beijing
关键词
Attention mechanisms; Convolutional neural network; Long Short-Term Memory(LSTM) network; Muilti-label; Multi-scale; Satellite images classification;
D O I
10.3788/OPE.20202806.1404
中图分类号
学科分类号
摘要
Due to the complexity of the background in aerial images and the diversity of object categories, aerial image classification is a challenging task. In order to address the problems of low accuracy and poor generalization in traditional multi-label aerial image classification methods, a method based on recurrent neural networks was proposed. In this method, the super-pixel segmentation algorithm was first used to obtain the low-level features of the image from which an attention map was generated. Subsequently, the best image scale was obtained by cross-validation, and multi-scale attention feature graphs were embedded into aconvolutional neural network in order to extract the features of the image. Finally, tomine the correlation between labels, an improved bidirectional Long Short-Term Memory (LSTM)network was proposed, which increases the connection from the input gate to the output gate, so that the input state can efficiently control the output information of each memory unit. The forget gate and the input gate were combined into a single update gate so that the improved bidirectional LSTM network can learn long-term historical information. The results obtained by applying the proposed method to the UCM multi-label dataset indicate that for scale values of 1, 1.3, and 2, the accuracy and recall rates of the model are 85.33% and 87.05% respectively, while the F1 score reached 0.862. The accuracyand recall rates are found to be higher than those of theVGGNet16 model by 7.25% and 8.94% respectively. The experimental results thus indicate that the proposed method can effectively increase the accuracy of multi-label aerial image classification. © 2020, Science Press. All right reserved.
引用
收藏
页码:1404 / 1413
页数:9
相关论文
共 16 条
  • [1] ZHENG Y P, LI G Y, LI Y., Survey of application of deep learning in image recognition, Computer Engineering and Applications, 55, 12, pp. 20-36, (2019)
  • [2] LI X B, JIAN B T, WANG SH J., A review and comparison of optical remote sensing scene classification, Radio Engineering, 49, 4, pp. 265-271, (2019)
  • [3] DENG L Y., Application of LVQ neural network in remote sensing image classification, Modern Electronics Technique, 43, 1, pp. 40-43, (2020)
  • [4] YANG ZH, MU X D, WANG SH Y, Et al., Scene classification of remote sensing images based on multi-scale features fusion, Opt. Precision Eng, 26, 12, pp. 232-240, (2018)
  • [5] LI Y, LIU X Y, ZHANG H Q, Et al., Optical remote sensing image retrieval based on convolution neural network, Opt. Precision Eng, 26, 1, pp. 200-207, (2018)
  • [6] ZEGGADA A, BENBRAIKA S, MELGANI F, Et al., Multi-label conditional random field classification for UAV images, IEEE Geoscience and Remote Sensing Letters, 15, 3, pp. 399-403, (2018)
  • [7] KODA S, ZEGGADA A, MELGANI F, Et al., Spatial and structured SVM for multi-label image classification, IEEE Transactions on Geoscience and Remote Sensing, 56, 10, pp. 5948-5960, (2018)
  • [8] BIAN X Y, FEI X J, MU N., Remote sensing image scene classification based scale-attention network, Journal of Computer Applications, 40, 3, pp. 872-877, (2020)
  • [9] ACHANTA R, SHAJI A, SMITH K, Et al., SLIC superpixel compared to state-of-the-art superpixel methods, IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 11, pp. 2274-2282, (2012)
  • [10] HE K, ZHANG X, REN S, Et al., Deep residual learning for image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778, (2016)