Pixel-Level Remote Sensing Image Recognition Based on Bidirectional Word Vectors

被引:82
|
作者
Yo, Hongfeng [1 ]
Tian, Shengwei [2 ]
Yu, Long [3 ]
Lv, Yalong [1 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830000, Peoples R China
[2] Xinjiang Univ, Software Coll, Urumqi 830000, Peoples R China
[3] Xinjiang Univ, Network Ctr, Urumqi 830000, Peoples R China
来源
关键词
Feature extraction; Remote sensing; Recurrent neural networks; Image recognition; Semantics; Deep learning; Image color analysis; Attention mechanism; bidirectional independent recurrent neural network (BiIndRNN); bidirectional word vector; graph convolutional networks (GCNs); parallel joint algorithm; sliced recurrent neural network (SRNN); CLASSIFICATION; SEGMENTATION; NETWORKS;
D O I
10.1109/TGRS.2019.2945591
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In the traditional remote sensing image recognition, the traditional features (e.g., color features and texture features) cannot fully describe complex images, and the relationships between image pixels cannot be captured well. Using a single model or a traditional sequential joint model, it is easy to lose deep features during feature mining. This article proposes a new feature extraction method that uses the word embedding method from natural language processing to generate bidirectional real dense vectors to reflect the contextual relationships between the pixels. A bidirectional independent recurrent neural network (BiIndRNN) is combined with a convolutional neural network (CNN) to improve the sliced recurrent neural network (SRNN) algorithm model, which is then constructed in parallel with graph convolutional networks (GCNs) under an attention mechanism to fully exploit the deep features of images and to capture the semantic information of the context. This model is collectively named an improved SRNN and attention-treated GCN-based parallel (SAGP) model. Experiments conducted on Populus euphratica forests demonstrate that the proposed method outperforms traditional methods in terms of recognition accuracy. The validation done on public data set also proved it.
引用
收藏
页码:1281 / 1293
页数:13
相关论文
共 50 条
  • [21] Pixel-level image fusion: The case of image sequences
    Rockinger, O
    Fechner, T
    SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION VII, 1998, 3374 : 378 - 388
  • [22] Triplet Adversarial Domain Adaptation for Pixel-Level Classification of VHR Remote Sensing Images
    Yan, Liang
    Fan, Bin
    Liu, Hongmin
    Huo, Chunlei
    Xiang, Shiming
    Pan, Chunhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3558 - 3573
  • [23] PIXEL-LEVEL ANNOTATION OF SPECIFIC TARGETS FOR LARGE-SCALE REMOTE SENSING IMAGES
    Liu, Guolong
    Hu, Wei
    Zhang, Fan
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6374 - 6377
  • [24] Optimising multiresolution pixel-level image fusion
    Petrovic, V
    Xydeas, C
    SENSOR FUSION: ARCHITECTURES, ALGORITHMS AND APPLICATIONS V, 2001, 4385 : 96 - 107
  • [25] A multiscale approach to pixel-level image fusion
    Ben Hamza, A
    He, Y
    Krim, H
    Willsky, A
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2005, 12 (02) : 135 - 146
  • [26] Generic interactive pixel-level image editing
    Liang, Y.
    Gan, Y.
    Chen, M.
    Gutierrez, D.
    Munoz, A.
    COMPUTER GRAPHICS FORUM, 2019, 38 (07) : 23 - 34
  • [27] Explaining Face Recognition Through SHAP-Based Pixel-Level Face Image Quality Assessment
    Biagi, Clara
    Rethfeld, Louis
    Kuijper, Arjan
    Terhoerst, Philipp
    2023 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS, IJCB, 2023,
  • [28] Pixel-level robust digital image correlation
    Cofaru, Corneliu
    Philips, Wilfried
    Van Paepegem, Wim
    OPTICS EXPRESS, 2013, 21 (24): : 29979 - 29999
  • [29] Review on Technology of Pixel-level Image Fusion
    Li, Mingjing
    Dong, Yubing
    PROCEEDINGS OF 2013 2ND INTERNATIONAL CONFERENCE ON MEASUREMENT, INFORMATION AND CONTROL (ICMIC 2013), VOLS 1 & 2, 2013, : 341 - 344
  • [30] Pixel-Level Recognition of Pavement Distresses Based on U-Net
    Li, Deru
    Duan, Zhongdong
    Hu, Xiaoyang
    Zhang, Dongchang
    ADVANCES IN MATERIALS SCIENCE AND ENGINEERING, 2021, 2021