The Effects of Precision Constraints in a Backpropagation Learning Network

被引：44

作者：

Hollis, Paul W. ^{[1
]}

Harper, John S. ^{[1
]}

Paulos, John J. ^{[1
]}

机构：

[1] North Carolina State Univ, Dept Elect & Comp Engn, Raleigh, NC 27695 USA

来源：

NEURAL COMPUTATION | 1990年 / 2卷 / 03期

关键词：

D O I：

10.1162/neco.1990.2.3.363

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper presents a study of precision constraints imposed by a hybrid chip architecture with analog neurons and digital backpropagation calculations. Conversions between the analog and digital domains and weight storage restrictions impose precision limits on both analog and digital calculations. It is shown through simulations that a learning system of this nature can be implemented in spite of limited resolution in the analog circuits and using fixed point arithmetic to implement the backpropagation algorithm.

引用

页码：363 / 373

页数：11

共 50 条

[21] Neural network models for survival analysis using backpropagation or Bayesian learning
Trinh, QA
Hoang, T
Asselain, B
STAIRS 2002, PROCEEDINGS, 2002, 78 : 167 - 176
[22] Spiking Neural Network With Backpropagation Learning for Brain Visual Dynamics Decoding
Stauffer, Jake
Zhang, Qingxue
2023 11TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING, NER, 2023,
[23] Design of Fully Analogue Artificial Neural Network with Learning Based on Backpropagation
Paulu, Filip
Hospodka, Jiri
RADIOENGINEERING, 2021, 30 (02) : 357 - 363
[24] Semi-Supervised Learning Combining Backpropagation and STDP: STDP Enhances Learning by Backpropagation with a Small Amount of Labeled Data in a Spiking Neural Network
Furuya, Kotaro
Ohkubo, Jun
JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2021, 90 (07)
[25] NEOCOGNITRON LEARNING BY BACKPROPAGATION
OHNO, M
OKADA, M
FUKUSHIMA, K
SYSTEMS AND COMPUTERS IN JAPAN, 1995, 26 (05) : 19 - 28
[26] Spatiotemporal Backpropagation based on Channel Reward for Training High-Precision Spiking Neural Network
Li-Ye Niu
Ying Wei
Yue Liu
Jun-Yu Long
Wen-Bo Liu
Signal, Image and Video Processing, 2023, 17 : 3467 - 3476
[27] Spatiotemporal Backpropagation based on Channel Reward for Training High-Precision Spiking Neural Network
Niu, Li-Ye
Wei, Ying
Liu, Yue
Long, Jun-Yu
Liu, Wen-Bo
SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (07) : 3467 - 3476
[28] Structural constraints on learning in the neural network
Martinez, Clarisa A.
Wang, Chunji
JOURNAL OF NEUROPHYSIOLOGY, 2015, 114 (05) : 2555 - 2557
[29] Bayesian network learning with parameter constraints
Computer Aided Diagnosis and Therapy Group, Siemens Medical Solutions, 51 Valley Stream Parkway, Malvern, PA 19355, United States
不详
J. Mach. Learn. Res., 2006, (1357-1383):
[30] Bayesian network learning with parameter constraints
Niculescu, Radu Stefan
Mitchell, Tom M.
Rao, R. Bharat
JOURNAL OF MACHINE LEARNING RESEARCH, 2006, 7 : 1357 - 1383

← 1 2 3 4 5 →