Pruning method for dendritic neuron model based on dendrite layer significance constraints

被引:8
|
作者
Luo, Xudong [1 ,2 ]
Wen, Xiaohao [3 ,4 ]
Li, Yan [3 ]
Li, Quanfu [5 ]
机构
[1] Guangxi Normal Univ, Key Lab Educ Blockchain & Intelligent Technol, Minist Educ, Guilin, Peoples R China
[2] Guangxi Normal Univ, Guangxi Key Lab Multisource Informat Min & Secur, Guilin, Peoples R China
[3] Guangxi Normal Univ, Teachers Coll Vocat & Tech Educ, Guilin 541004, Peoples R China
[4] New Jersey Inst Technol, Elect & Comp Engn, Newark, NJ USA
[5] Guangxi Normal Univ, Coll Elect Engn, Guilin, Peoples R China
基金
中国国家自然科学基金;
关键词
compression; computational intelligence; deep learning; neural network; machine learning; NETWORK;
D O I
10.1049/cit2.12234
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The dendritic neural model (DNM) mimics the non-linearity of synapses in the human brain to simulate the information processing mechanisms and procedures of neurons. This enhances the understanding of biological nervous systems and the applicability of the model in various fields. However, the existing DNM suffers from high complexity and limited generalisation capability. To address these issues, a DNM pruning method with dendrite layer significance constraints is proposed. This method not only evaluates the significance of dendrite layers but also allocates the significance of a few dendrite layers in the trained model to a few dendrite layers, allowing the removal of low-significance dendrite layers. The simulation experiments on six UCI datasets demonstrate that our method surpasses existing pruning methods in terms of network size and generalisation performance.
引用
收藏
页码:308 / 318
页数:11
相关论文
共 50 条
  • [21] Optimization Based Layer-Wise Pruning Threshold Method for Accelerating Convolutional Neural Networks
    Ding, Yunlong
    Chen, Di-Rong
    MATHEMATICS, 2023, 11 (15)
  • [22] Radio Signal Modulation Recognition Method Based on Deep Learning Model Pruning
    Hao, Xinyu
    Xia, Zhang
    Jiang, Mengxi
    Ye, Qiubo
    Yang, Guangsong
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [23] CSI feedback method for dynamically adjusting compression rate based on model pruning
    Shao K.
    Du Z.
    Wang G.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2023, 45 (08): : 2615 - 2622
  • [24] CPN Model Checking Method of Concurrent Software Based on State Space Pruning
    Sun, Tao
    Yang, Jing
    Zhong, Wenjie
    2020 IEEE 19TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2020), 2020, : 1391 - 1395
  • [25] Hausdorff distance template matching method based on gradient phase and significance constraints
    Li, Zhijun
    Liu, Songlin
    Niu, Zhaodong
    Chen, Zengping
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2015, 44 (02): : 775 - 780
  • [26] Method of Convolutional Neural Network Model Pruning Based on Gray Correlation Analysis
    Huang Shiqing
    Bai Ruilin
    Qin Gaoe
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)
  • [27] Mr2DNM: A Novel Mutual Information-Based Dendritic Neuron Model
    Qian, Xiaoxiao
    Wang, Yirui
    Cao, Shuyang
    Todo, Yuki
    Gao, Shangce
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2019, 2019
  • [28] Intelligent Financial Forecasting With an Improved Chemical Reaction Optimization Algorithm Based Dendritic Neuron Model
    Nayak, Sarat Chandra
    Dehuri, Satchidananda
    Cho, Sung-Bae
    IEEE ACCESS, 2022, 10 : 130921 - 130943
  • [29] Reaction–Diffusion Model-Based Research on Formation Mechanism of Neuron Dendritic Spine Patterns
    Jia, Yiqing
    Zhao, Qili
    Yin, Hongqiang
    Guo, Shan
    Sun, Mingzhu
    Yang, Zhuo
    Zhao, Xin
    Frontiers in Neurorobotics, 2021, 15
  • [30] An FPGA-based Implementation Method for Quadratic Spiking Neuron Model
    Lin, Xianghong
    Lu, Han
    Pi, Xiaomei
    Wang, Xiangwen
    2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 621 - 627