L1 NORMALIZATION IN NEURAL NETWORKS USING PARALLEL AUTOMATIC LEVEL CONTROL

被引:1
|
作者
PERFETTI, R
机构
[1] Info-Com Dpt., Universita di Roma ‘La Sapienza’, 00184 Roma
关键词
Artificial intelligence; Circuit theory and design; Networks; Neural networks; Pattern recognition;
D O I
10.1049/el:19900055
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A simple circuit that performs L1 normalisation of positivevalued parallel inputs is proposed. It can be utilised to implement ‘on-line’ normalisation of input patterns or weight vectors in neural networks based on competitive learning mechanisms. A modified scheme with high linearity is also presented. © 1990, The Institution of Electrical Engineers. All rights reserved.
引用
收藏
页码:82 / 84
页数:3
相关论文
共 50 条
  • [1] SPARSE DEEP NEURAL NETWORKS USING L1,∞-WEIGHT NORMALIZATION
    Wen, Ming
    Xu, Yixi
    Zheng, Yunling
    Yang, Zhouwang
    Wang, Xiao
    [J]. STATISTICA SINICA, 2021, 31 (03) : 1397 - 1414
  • [2] Nonlinear Model Predictive Control with L1 Cost-Function Using Neural Networks for Multivariable Processes
    Nebeluk, Robert
    Lawrynczuk, Maciej
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 1591 - 1596
  • [3] Compact Deep Neural Networks with l1,1 and l1,2 Regularization
    Ma, Rongrong
    Niu, Lingfeng
    [J]. 2018 18TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2018, : 1248 - 1254
  • [4] A practical approach for accurate positioning with L1 GPS receivers using neural networks
    Mosavi, M.R.
    [J]. Journal of Intelligent and Fuzzy Systems, 2006, 17 (02): : 159 - 171
  • [5] Structure Optimization of Neural Networks with L1 Regularization on Gates
    Chang, Qin
    Wang, Junze
    Zhang, Huaqing
    Shi, Lina
    Wang, Jian
    Pal, Nikhil R.
    [J]. 2018 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2018, : 196 - 203
  • [6] Cooperative recurrent neural networks for the constrained L1 estimator
    Xia, Youshen
    Kamel, Mohamed S.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (07) : 3192 - 3206
  • [7] l1 Regularization in Two-Layer Neural Networks
    Li, Gen
    Gu, Yuantao
    Ding, Jie
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 135 - 139
  • [8] Structured Pruning of Convolutional Neural Networks via L1 Regularization
    Yang, Chen
    Yang, Zhenghong
    Khattak, Abdul Mateen
    Yang, Liu
    Zhang, Wenxin
    Gao, Wanlin
    Wang, Minjuan
    [J]. IEEE ACCESS, 2019, 7 : 106385 - 106394
  • [9] Prune Deep Neural Networks With the Modified L1/2 Penalty
    Chang, Jing
    Sha, Jin
    [J]. IEEE ACCESS, 2019, 7 : 2273 - 2280
  • [10] Transformed l1 regularization for learning sparse deep neural networks
    Ma, Rongrong
    Miao, Jianyu
    Niu, Lingfeng
    Zhang, Peng
    [J]. NEURAL NETWORKS, 2019, 119 : 286 - 298