Random Topology and Random Multiscale Mapping: An Automated Design of Multiscale and Lightweight Neural Network for Remote-Sensing Image Recognition

被引:13
|
作者
Li, Jihao [1 ,2 ,3 ,4 ]
Weinmann, Martin [5 ]
Sun, Xian [1 ,2 ,3 ,4 ]
Diao, Wenhui [1 ,2 ]
Feng, Yingchao [1 ,2 ,3 ,4 ]
Fu, Kun [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Key Lab Network Informat Syst Technol NIST, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
[5] Karlsruhe Inst Technol, Inst Photogrammetry & Remote Sensing, D-76131 Karlsruhe, Germany
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Computer architecture; Topology; Generators; Biological neural networks; Deep learning; Deep learning (DL); multiscale and lightweight architecture; neural architecture search (NAS); random graph theory; remote sensing; OBJECT DETECTION; SCENE; CLASSIFICATION; FUSION;
D O I
10.1109/TGRS.2021.3102988
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the proposal of neural architecture search (NAS), automated network architecture design gradually becomes a new way in deep learning research. Due to its high capability regarding automated design, some pioneers have made an attempt to apply NAS in remote sensing and made some achievements, like 1-D/3-D Auto-convolutional neural network (CNN) and polarimetric synthetic aperture radar (PolSAR)-tailored Differentiable Architecture Search (PDAS). However, there are still some areas to be improved for existing NAS in remote-sensing field. In this article, we propose a random topology and random multiscale mapping (RTRMM) method to generate a multiscale and lightweight architecture for remote-sensing image recognition. First, a random topology generator generates the topology through random graph. Second, during the experiment, we find remote-sensing image features extracted by a multiscale network are more appropriate, compared with features extracted by a single-scale model. Nevertheless, the complexity inevitably increases with the introduction of a multiscale concept. Consequently, we design a variable search space consisting of decomposition convolution units under the guidance of mathematical analysis. The mapping of each neuron is then determined by a random multiscale mapping sampler. After that, we assemble the topology and mappings into blocks and construct three RTRMM models. Experiments on four scene classification datasets confirm the feature extraction capability and lightweight performance of RTRMM models. Moreover, we also observe that our approach achieves a better tradeoff between floating-point operations (FLOPs) and accuracy than some current well-behaved methods. Furthermore, the results on Vaihingen dataset verify the high feature-transfer capability.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] MU-Net: A MULTISCALE UNSUPERVISED NETWORK FOR REMOTE SENSING IMAGE REGISTRATION
    Tang, Tengfeng
    Chen, Tingting
    Zhu, Bai
    Ye, Yuanxin
    [J]. XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 43-B3 : 537 - 544
  • [32] Object Detection For Remote Sensing Image Based on Multiscale Feature Fusion Network
    Tian Tingting
    Yang Jun
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [33] Seismic Random Noise Attenuation by Applying Multiscale Denoising Convolutional Neural Network
    Zhong, Tie
    Cheng, Ming
    Dong, Xintong
    Wu, Ning
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [34] Remote Sensing Image Semantic Segmentation Method Based on a Deep Convolutional Neural Network and Multiscale Feature Fusion
    Zhang, Guangzhen
    Jiang, Wangyang
    [J]. INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2023, 19 (01)
  • [35] MFCANet: Multiscale Feature Context Aggregation Network for Oriented Object Detection in Remote-Sensing Images
    Jiang, Honghui
    Luo, Tingting
    Peng, Hu
    Zhang, Guozheng
    [J]. IEEE ACCESS, 2024, 12 : 45986 - 46001
  • [36] Remote-Sensing Image Classification Based on an Improved Probabilistic Neural Network
    Zhang, Yudong
    Wu, Lenan
    Neggaz, Nabil
    Wang, Shuihua
    Wei, Geng
    [J]. SENSORS, 2009, 9 (09) : 7516 - 7539
  • [37] Deep neural network for remote-sensing image interpretation: status and perspectives
    Li, Jiayi
    Huang, Xin
    Gong, Jianya
    [J]. NATIONAL SCIENCE REVIEW, 2019, 6 (06) : 1082 - +
  • [38] Deep neural network for remote-sensing image interpretation: status and perspectives
    Jiayi Li
    Xin Huang
    Jianya Gong
    [J]. National Science Review, 2019, 6 (06) : 1082 - 1086
  • [39] An Efficient Lightweight Neural Network for Remote Sensing Image Change Detection
    Song, Kaiqiang
    Cui, Fengzhi
    Jiang, Jie
    [J]. REMOTE SENSING, 2021, 13 (24)
  • [40] Multimodal Image Alignment Through a Multiscale Chain of Neural Networks with Application to Remote Sensing
    Zampieri, Armand
    Charpiat, Guillaume
    Girard, Nicolas
    Tarabalka, Yuliya
    [J]. COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 : 679 - 696