Random Topology and Random Multiscale Mapping: An Automated Design of Multiscale and Lightweight Neural Network for Remote-Sensing Image Recognition

被引:13
|
作者
Li, Jihao [1 ,2 ,3 ,4 ]
Weinmann, Martin [5 ]
Sun, Xian [1 ,2 ,3 ,4 ]
Diao, Wenhui [1 ,2 ]
Feng, Yingchao [1 ,2 ,3 ,4 ]
Fu, Kun [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Key Lab Network Informat Syst Technol NIST, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
[5] Karlsruhe Inst Technol, Inst Photogrammetry & Remote Sensing, D-76131 Karlsruhe, Germany
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Computer architecture; Topology; Generators; Biological neural networks; Deep learning; Deep learning (DL); multiscale and lightweight architecture; neural architecture search (NAS); random graph theory; remote sensing; OBJECT DETECTION; SCENE; CLASSIFICATION; FUSION;
D O I
10.1109/TGRS.2021.3102988
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the proposal of neural architecture search (NAS), automated network architecture design gradually becomes a new way in deep learning research. Due to its high capability regarding automated design, some pioneers have made an attempt to apply NAS in remote sensing and made some achievements, like 1-D/3-D Auto-convolutional neural network (CNN) and polarimetric synthetic aperture radar (PolSAR)-tailored Differentiable Architecture Search (PDAS). However, there are still some areas to be improved for existing NAS in remote-sensing field. In this article, we propose a random topology and random multiscale mapping (RTRMM) method to generate a multiscale and lightweight architecture for remote-sensing image recognition. First, a random topology generator generates the topology through random graph. Second, during the experiment, we find remote-sensing image features extracted by a multiscale network are more appropriate, compared with features extracted by a single-scale model. Nevertheless, the complexity inevitably increases with the introduction of a multiscale concept. Consequently, we design a variable search space consisting of decomposition convolution units under the guidance of mathematical analysis. The mapping of each neuron is then determined by a random multiscale mapping sampler. After that, we assemble the topology and mappings into blocks and construct three RTRMM models. Experiments on four scene classification datasets confirm the feature extraction capability and lightweight performance of RTRMM models. Moreover, we also observe that our approach achieves a better tradeoff between floating-point operations (FLOPs) and accuracy than some current well-behaved methods. Furthermore, the results on Vaihingen dataset verify the high feature-transfer capability.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] A Lightweight and Multiscale Network for Remote Sensing Image Scene Classification
    Bai, Lin
    Liu, Qingxin
    Li, Cuiling
    Zhu, Chunlin
    Ye, Zhen
    Xi, Meng
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [2] Regional multiscale Markov random field for remote sensing image classification
    Dai, Qinling
    Luo, Bin
    Zheng, Chen
    Wang, Leiguang
    [J]. Yaogan Xuebao/Journal of Remote Sensing, 2020, 24 (03): : 245 - 253
  • [3] Multiscale Methods for Optical Remote-Sensing Image Captioning
    Ma, Xiaofeng
    Zhao, Rui
    Shi, Zhenwei
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (11) : 2001 - 2005
  • [4] DMSHNet: Multiscale and Multisupervised Hierarchical Network for Remote-Sensing Image Change Detection
    Liu, Pengcheng
    Zheng, Panpan
    Wang, Liejun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] CMTFNet: CNN and Multiscale Transformer Fusion Network for Remote-Sensing Image Semantic Segmentation
    Wu, Honglin
    Huang, Peng
    Zhang, Min
    Tang, Wenlong
    Yu, Xinyu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] NestNet: a multiscale convolutional neural network for remote sensing image change detection
    Yu, Xiao
    Fan, Junfu
    Chen, Jiahao
    Zhang, Peng
    Zhou, Yuke
    Han, Liusheng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (13) : 4902 - 4925
  • [7] Multiscale Multiinteraction Network for Remote Sensing Image Captioning
    Wang, Yong
    Zhang, Wenkai
    Zhang, Zhengyuan
    Gao, Xin
    Sun, Xian
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 2154 - 2165
  • [8] Multiscale comparison of remote-sensing data for linear woody vegetation mapping
    Vannier, Clemence
    Hubert-Moy, Laurence
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2014, 35 (21) : 7376 - 7399
  • [9] A Lightweight Multiscale Feature Fusion Network for Remote Sensing Object Counting
    Yi, Jun
    Shen, Zhilong
    Chen, Fan
    Zhao, Yiheng
    Xiao, Shan
    Zhou, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [10] Multiscale Feature Aggregation Capsule Neural Network for Hyperspectral Remote Sensing Image Classification
    Lei, Runmin
    Zhang, Chunju
    Zhang, Xueying
    Huang, Jianwei
    Li, Zhenxuan
    Liu, Wencong
    Cui, Hao
    [J]. REMOTE SENSING, 2022, 14 (07)