Pruning method for dendritic neuron model based on dendrite layer significance constraints

被引:8
|
作者
Luo, Xudong [1 ,2 ]
Wen, Xiaohao [3 ,4 ]
Li, Yan [3 ]
Li, Quanfu [5 ]
机构
[1] Guangxi Normal Univ, Key Lab Educ Blockchain & Intelligent Technol, Minist Educ, Guilin, Peoples R China
[2] Guangxi Normal Univ, Guangxi Key Lab Multisource Informat Min & Secur, Guilin, Peoples R China
[3] Guangxi Normal Univ, Teachers Coll Vocat & Tech Educ, Guilin 541004, Peoples R China
[4] New Jersey Inst Technol, Elect & Comp Engn, Newark, NJ USA
[5] Guangxi Normal Univ, Coll Elect Engn, Guilin, Peoples R China
基金
中国国家自然科学基金;
关键词
compression; computational intelligence; deep learning; neural network; machine learning; NETWORK;
D O I
10.1049/cit2.12234
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The dendritic neural model (DNM) mimics the non-linearity of synapses in the human brain to simulate the information processing mechanisms and procedures of neurons. This enhances the understanding of biological nervous systems and the applicability of the model in various fields. However, the existing DNM suffers from high complexity and limited generalisation capability. To address these issues, a DNM pruning method with dendrite layer significance constraints is proposed. This method not only evaluates the significance of dendrite layers but also allocates the significance of a few dendrite layers in the trained model to a few dendrite layers, allowing the removal of low-significance dendrite layers. The simulation experiments on six UCI datasets demonstrate that our method surpasses existing pruning methods in terms of network size and generalisation performance.
引用
收藏
页码:308 / 318
页数:11
相关论文
共 50 条
  • [1] Pruning of Dendritic Neuron Model with Significance Constraints for Classification
    Luo, Xudong
    Ye, Long
    Liu, Xiaolan
    Wen, Xiaohao
    Zhang, Qin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [2] A model of the neuron based on dendrite mechanisms
    Tang, Z
    Tamura, H
    Kuratu, M
    Ishizuka, O
    Tanno, K
    ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 2001, 84 (08): : 11 - 24
  • [3] Intuitionistic fuzzy time series forecasting method based on dendrite neuron model and exponential smoothing
    Cansu, Turan
    Bas, Eren
    Egrioglu, Erol
    Akkan, Tamer
    GRANULAR COMPUTING, 2024, 9 (02)
  • [4] An Efficient Binary Search Based Neuron Pruning Method for ConvNet Condensation
    Zhang, Boyu
    Qin, A. K.
    Chan, Jeffrey
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 189 - 197
  • [5] Verification of Classification Model and Dendritic Neuron Model Based on Machine Learning
    Jia, Dongbao
    Xu, Weixiang
    Liu, Dengzhi
    Xu, Zhongxun
    Zhong, Zhaoman
    Ban, Xinxin
    DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2022, 2022
  • [6] Visual Analytics of Learning Behavior Based on the Dendritic Neuron Model
    Tang, Cheng
    Chen, Li
    Li, Gen
    Minematsu, Tsubasa
    Okubo, Fumiya
    Taniguchi, Yuta
    Shimada, Atsushi
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, KSEM 2024, 2024, 14885 : 192 - 203
  • [7] Layer-wise Model Pruning based on Mutual Information
    Fan, Chun
    Li, Jiwei
    Ao, Xiang
    Wu, Fei
    Meng, Yuxian
    Sun, Xiaofei
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 3079 - 3090
  • [8] A Neuron-Significance-Index-based Self-organization Pruning Algorithm for S-LINN
    Yang, Gang
    Wang, Le
    Chen, Wen
    Dai, Lizhen
    Yang, Hui
    IFAC PAPERSONLINE, 2017, 50 (01): : 14976 - 14981
  • [9] The Optimization Method of Knowledge Distillation Based on Model Pruning
    Wu, Min
    Ma, Weihua
    Li, Yue
    Zhao, Xiongbo
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1386 - 1390
  • [10] A significance coding algorithm based on layer model
    Zhou, Ying-Hong
    Ma, Zheng-Ming
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2009, 31 (06): : 1497 - 1500