Remote-Sensing Scene Classification Based on Memristor Convolutional Neural Network

被引:0
|
作者
Zhao Yibo [1 ,2 ]
Zhang Yi [1 ,2 ]
Yu Chengcheng [1 ,2 ]
Yang Qing [1 ,2 ]
机构
[1] Nanjing Univ Informat Sci Technol, Sch Elect & Informat Engn, Nanjing 210044, Jiangsu, Peoples R China
[2] Nanjing Univ Informat Sci Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing 210044, Jiangsu, Peoples R China
关键词
remote sensing scenes; convolutional neural network; memristor; image classification;
D O I
10.3788/LOP240560
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote-sensing images typically present multiple scene categories, significant intraclass variance, and high interclass similarity. Conventional deep networks such as convolutional neural networks (CNNs) can neither adequately represent the features of target objects nor accurately distinguish between object and background information in remotesensing scene images. Moreover, these networks typically exhibit large parameter sizes, thus resulting in low classification accuracy and inefficient training. Hence, a resistive CNN that can perform remote-sensing scene classification is proposed. A context-aware enhanced transformer module was introduced to fuse shared weights and context-aware weights for capturing both high- and low-frequency features. A multiscale selective kernel (SK) unit building block was integrated into the convolution block, and different convolution kernels were selected based on feature maps of different levels. Additionally, feature information of different scales was extracted to improve the processing ability of the model for complex scenes. Furthermore, a low-power and high-speed resistive CNN was constructed by weight mapping resistor crossbar arrays, thus reducing the computational overhead. Experimental results on the publicly available UCMercedLandUse dataset with 21 classes and the NWPU-RESISC45 dataset with 45 classes indicate classification accuracies of 94. 76% and 87. 54%, respectively. These accuracies represent improvements of 5. 95 percentage points and 5. 07 percentage points, respectively, compared with baseline models in addition to significantly reduced model parameters. The accuracy losses of the improved resistive CNN model on the two abovementioned datasets are only 0. 24 percentage points and 0. 23 percentage points, respectively. Thus, it is a promising model for promoting the advancement of edge computing.
引用
收藏
页数:12
相关论文
共 44 条
  • [1] Equivalent-accuracy accelerated neural-network training using analogue memory
    Ambrogio, Stefano
    Narayanan, Pritish
    Tsai, Hsinyu
    Shelby, Robert M.
    Boybat, Irem
    di Nolfo, Carmelo
    Sidler, Severin
    Giordano, Massimo
    Bodini, Martina
    Farinha, Nathan C. P.
    Killeen, Benjamin
    Cheng, Christina
    Jaoudi, Yassine
    Burr, Geoffrey W.
    [J]. NATURE, 2018, 558 (7708) : 60 - +
  • [2] [Anonymous], 2023, RAProtoNet, V60
  • [3] Memristor-Based CNNs for Detecting Stress Using Brain Imaging Signals
    Bak, SuJin
    Park, Jinwoo
    Lee, Jaehoon
    Jeong, Jichai
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (01): : 140 - 149
  • [4] Hyperspectral Remote-Sensing Classification Combining Transformer and Multiscale Residual Mechanisms
    Chen Yuhan
    Wang Bo
    Yan Qingyun
    Huang Bingjie
    Jia Tong
    Xue Bin
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (12)
  • [5] Remote Sensing Image Scene Classification: Benchmark and State of the Art
    Cheng, Gong
    Han, Junwei
    Lu, Xiaoqiang
    [J]. PROCEEDINGS OF THE IEEE, 2017, 105 (10) : 1865 - 1883
  • [6] Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVW and pLSA
    Cheng, Gong
    Guo, Lei
    Zhao, Tianyun
    Han, Junwei
    Li, Huihui
    Fang, Jun
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2013, 34 (01) : 45 - 59
  • [7] Xception: Deep Learning with Depthwise Separable Convolutions
    Chollet, Francois
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1800 - 1807
  • [8] MEMRISTOR - MISSING CIRCUIT ELEMENT
    CHUA, LO
    [J]. IEEE TRANSACTIONS ON CIRCUIT THEORY, 1971, CT18 (05): : 507 - +
  • [9] Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention
    Garnot, V. Sainte Fare
    Landrieu, L.
    Giordano, S.
    Chehata, N.
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 12322 - 12331
  • [10] Classification Method of High-Resolution Remote Sensing Scenes Based on Fusion of Global and Local Deep Features
    Gong Xi
    Wu Liang
    Xie Zhong
    Chen Zhanlong
    Liu Yuanyuan
    Yu Kan
    [J]. ACTA OPTICA SINICA, 2019, 39 (03)