Adaptive lightweight convolutional neural architecture search for segmentation problem

被引:2
|
作者
Wang, Wei [1 ,2 ]
Wang, Xianpeng [3 ]
Song, Xiangman [1 ]
机构
[1] Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang, Peoples R China
[2] Northeastern Univ, Key Lab Data Analyt & Optimizat Smart Ind, Minist Educ, Shenyang, Peoples R China
[3] Liaoning Key Lab Mfg Syst & Logist Optimizat, Liaoning Engn Lab Data Analyt & Optimizat Smart In, Shenyang, Peoples R China
基金
国家自然科学基金重大项目; 中国国家自然科学基金;
关键词
Convolutional neural network (CNN); neural architecture search (NAS); feature grouping; evolutionary algorithm; RETINAL VESSEL SEGMENTATION; U-NET; NETWORKS;
D O I
10.1080/0305215X.2023.2225036
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Convolutional neural networks (CNNs) have been shown to have the most advanced performance on image segmentation tasks. However, designing a reasonable convolutional neural network architecture requires a great deal of empirical knowledge, which can be expensive or unavailable in a variety of actual applications. To handle this problem, neural architecture search (NAS) has been developed by simultaneously optimizing the network architecture and hyperparameters, the main disadvantage of which is the requirement for extremely high computational resources. To accelerate the NAS of CNNs, a two-stage adaptive lightweight convolutional neural architecture search (AL-CNAS) method is proposed in this article based on an evolutionary algorithm. In this method, the original search space is divided into two parts based on feature grouping, and only one part is optimized at each stage to achieve an exponential decrease in the number of genotype combinations, which helps to improve search efficiency and reduce computational resource requirements. The proposed AL-CNAS is validated on the real-world segmentation of steel microstructure and two benchmark segmentation problems, and the computational results show that the proposed AL-CNAS has good segmentation performance and generality.
引用
收藏
页码:1122 / 1139
页数:18
相关论文
共 50 条
  • [1] Lightweight Neural Architecture Search for Temporal Convolutional Networks at the Edge
    Risso, Matteo
    Burrello, Alessio
    Conti, Francesco
    Lamberti, Lorenzo
    Chen, Yukai
    Benini, Luca
    Macii, Enrico
    Poncino, Massimo
    Pagliari, Daniele Jahier
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (03) : 744 - 758
  • [2] Efficient and lightweight convolutional neural network architecture search methods for object classification
    Lin, Chuen-Horng
    Chen, Tsung-Yi
    Chen, Huan-Yu
    Chan, Yung-Kuan
    [J]. PATTERN RECOGNITION, 2024, 156
  • [3] Leveraging Tensor Methods in Neural Architecture Search for the automatic development of lightweight Convolutional Neural Networks
    Dhanaraj, Mayur
    Do, Huyen
    Nair, Dinesh
    Xu, Cong
    [J]. BIG DATA IV: LEARNING, ANALYTICS, AND APPLICATIONS, 2022, 12097
  • [4] Neural Architecture Search for Convolutional Neural Networks with Attention
    Nakai, Kohei
    Matsubara, Takashi
    Uehara, Kuniaki
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (02) : 312 - 321
  • [5] ShuffleNeMt: modern lightweight convolutional neural network architecture
    Zhu, Meng
    Min, Weidong
    Han, Qing
    Zhan, Guowei
    Fu, Qiyan
    Li, Jiahao
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (04)
  • [6] Neural Architecture Search for Lightweight Neural Network in Food Recognition
    Tan, Ren Zhang
    Chew, XinYing
    Khaw, Khai Wah
    [J]. MATHEMATICS, 2021, 9 (11)
  • [7] Steganalysis of convolutional neural network based on neural architecture search
    Hongbo Wang
    Xingyu Pan
    Lingyan Fan
    Shuofeng Zhao
    [J]. Multimedia Systems, 2021, 27 : 379 - 387
  • [8] Steganalysis of convolutional neural network based on neural architecture search
    Wang, Hongbo
    Pan, Xingyu
    Fan, Lingyan
    Zhao, Shuofeng
    [J]. MULTIMEDIA SYSTEMS, 2021, 27 (03) : 379 - 387
  • [9] NASB: Neural Architecture Search for Binary Convolutional Neural Networks
    Zhu, Baozhou
    Al-Ars, Zaid
    Hofstee, H. Peter
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [10] Neural Architecture Search for Microscopy Cell Segmentation
    Zhu, Yanming
    Meijering, Erik
    [J]. MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2020, 2020, 12436 : 542 - 551