Unbounded Capacity Associative Memory for Real-valued Pattern Storage and Recall

被引：0

作者：

Salem, Fathi M. ^{[1
,2
]}

机构：

[1] Neural AI Syst Inst, Neurai Syst, Okemos, MI 48864 USA

[2] Michigan State Univ, Dept ECE, E Lansing, MI 48824 USA

来源：

2021 IEEE INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS) | 2021年

关键词：

Real-valued Associate Memory; Deep Learning; Neural Networks; Gradient Systems; (Stochastic) Gradient Descent; Non-convex Optimization;

D O I：

10.1109/MWSCAS47672.2021.9531698

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We describe an unbounded capacity Associative Memory which effectively stores and retrieves unrestricted real-valued data/patterns with fidelity. This Associative Memory arises from a gradient system of a (differentiable scalar) energy function, and thus can directly be incorporated within existing layers of computational Deep Learning (DL) frameworks. The design effort also describes two options for key pattern retrieval.

引用

页码：1066 / 1069

页数：4

共 50 条

[31] PATTERN STORAGE AND ASSOCIATIVE MEMORY IN QUASI-NEURAL NETWORKS
FORSHAW, MRB
PATTERN RECOGNITION LETTERS, 1986, 4 (06) : 427 - 431
[32] On fuzzy associative memory with multiple-rule storage capacity
Chung, FL
Lee, T
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1996, 4 (03) : 375 - 384
[33] Associative memory using ratio rule for multi-valued pattern association
Seow, MJ
Asari, VK
PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 2518 - 2522
[34] Nonbinary Associative Memory With Exponential Pattern Retrieval Capacity and Iterative Learning
Salavati, Amir Hesam
Kumar, K. Raj
Shokrollahi, Amin
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (03) : 557 - 570
[35] Exponential Pattern Retrieval Capacity with Non-Binary Associative Memory
Kumar, K. Raj
Salavati, Amir Hesam
Shokrollahi, Amin
2011 IEEE INFORMATION THEORY WORKSHOP (ITW), 2011,
[36] Pattern Stability on Complex-Valued Associative Memory by Local Iterative Learning Scheme
Yamamoto, Hiroki
Isokawa, Teijiro
Nishimura, Haruhiko
Kamiura, Naotake
Matsui, Nobuyuki
6TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS, AND THE 13TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS, 2012, : 39 - 42
[37] Capacity analysis of the asymptotically stable multi-valued exponential bidirectional associative memory
Natl Sun Yat-Sen Univ, Taiwan
IEEE Trans Syst Man Cybern Part B Cybern, 5 (733-743):
[38] Capacity analysis of the asymptotically stable multi-valued exponential bidirectional associative memory
Wang, CC
Hwang, SM
Lee, JP
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1996, 26 (05): : 733 - 743
[39] Noise masking for pattern recall using a single lattice matrix auto-associative memory
Urcid, Gonzalo
Ritter, Gerhard X.
2006 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-5, 2006, : 187 - +
[40] Implementation of bipolar real-valued input scenes in a real-time optical correlator: application to color pattern recognition
Moreno, I
Campos, J
Yzuel, MJ
Kober, V
OPTICAL ENGINEERING, 1998, 37 (01) : 144 - 150

← 1 2 3 4 5 →