Energy-Efficient Neuromorphic Classifiers

被引:17
|
作者
Marti, Daniel [1 ,2 ,3 ]
Rigotti, Mattia [3 ,4 ]
Seok, Mingoo [5 ]
Fusi, Stefano [3 ,6 ]
机构
[1] PSL Res Univ, Dept Etud Cognit, Ecole Normale Super, F-75005 Paris, France
[2] INSERM, F-75005 Paris, France
[3] Columbia Univ, Coll Phys & Surg, Ctr Theoret Neurosci, New York, NY 10032 USA
[4] IBM TJ Watson Res Ctr, Yorktown Hts, NY 10598 USA
[5] Columbia Univ, Dept Elect Engn, New York, NY 10027 USA
[6] Columbia Univ, Coll Phys & Surg, Mortimer B Zuckerman Mind Brain Behav Inst, New York, NY 10032 USA
关键词
NEURAL-NETWORKS; SYSTEM; CLASSIFICATION; RECOGNITION; PATTERNS; MACHINE;
D O I
10.1162/NECO_a_00882
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neuromorphic engineering combines the architectural and computational principles of systems neuroscience with semiconductor electronics, with the aim of building efficient and compact devices that mimic the synaptic and neural machinery of the brain. The energy consumptions promised by neuromorphic engineering are extremely low, comparable to those of the nervous system. Until now, however, the neuromorphic approach has been restricted to relatively simple circuits and specialized functions, thereby obfuscating a direct comparison of their energy consumption to that used by conventional von Neumann digital machines solving real-world tasks. Here we show that a recent technology developed by IBM can be leveraged to realize neuromorphic circuits that operate as classifiers of complex real-world stimuli. Specifically, we provide a set of general prescriptions to enable the practical implementation of neural architectures that compete with state-of-the-art classifiers. We also show that the energy consumption of these architectures, realized on the IBM chip, is typically two or more orders of magnitude lower than that of conventional digital machines implementing classifiers with comparable performance. Moreover, the spike-based dynamics display a trade-off between integration time and accuracy, which naturally translates into algorithms that can be flexibly deployed for either fast and approximate classifications, or more accurate classifications at the mere expense of longer running times and higher energy costs. This work finally proves that the neuromorphic approach can be efficiently used in real-world applications and has significant advantages over conventional digital devices when energy consumption is considered.
引用
收藏
页码:2011 / 2044
页数:34
相关论文
共 50 条
  • [1] Backpropagation for Energy-Efficient Neuromorphic Computing
    Esser, Steve K.
    Appuswamy, Rathinakumar
    Merolla, Paul A.
    Arthur, John V.
    Modha, Dharmendra S.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [2] Fast and Energy-efficient deep Neuromorphic Learning
    Goeltz, Julian
    Kriener, Laura
    Sabado, Virginie
    Petrovici, Mihai A.
    [J]. ERCIM NEWS, 2021, (125): : 17 - 18
  • [3] Energy-efficient memcapacitor devices for neuromorphic computing
    Demasius, Kai-Uwe
    Kirschen, Aron
    Parkin, Stuart
    [J]. NATURE ELECTRONICS, 2021, 4 (10) : 748 - 756
  • [4] Silicon photonics for energy-efficient neuromorphic computing
    Tossoun, Bassem
    [J]. EMERGING APPLICATIONS IN SILICON PHOTONICS III, 2022, 12334
  • [5] Energy-efficient memcapacitor devices for neuromorphic computing
    Kai-Uwe Demasius
    Aron Kirschen
    Stuart Parkin
    [J]. Nature Electronics, 2021, 4 : 748 - 756
  • [6] Neuromorphic Computing for Energy-Efficient Edge Intelligence
    Panda, Priya
    [J]. 2024 INTERNATIONAL VLSI SYMPOSIUM ON TECHNOLOGY, SYSTEMS AND APPLICATIONS, VLSI TSA, 2024,
  • [7] Memristor-based Energy-Efficient Neuromorphic Computing
    Tang, Jianshi
    [J]. 2022 INTERNATIONAL CONFERENCE ON IC DESIGN AND TECHNOLOGY (ICICDT), 2022, : XIX - XIX
  • [8] Convolutional networks for fast, energy-efficient neuromorphic computing
    Esser, Steven K.
    Merolla, Paul A.
    Arthur, John V.
    Cassidy, Andrew S.
    Appuswamy, Rathinakumar
    Andreopoulos, Alexander
    Berg, David J.
    McKinstry, Jeffrey L.
    Melano, Timothy
    Barch, Davis R.
    di Nolfo, Carmelo
    Datta, Pallab
    Amir, Arnon
    Taba, Brian
    Flickner, Myron D.
    Modha, Dharmendra S.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2016, 113 (41) : 11441 - 11446
  • [9] SENeCA: Scalable Energy-efficient Neuromorphic Computer Architecture
    Yousefzadeh, Amirreza
    Van Schaik, Gert-Jan
    Tahghighi, Mohammad
    Detterer, Paul
    Traferro, Stefano
    Hijdra, Martijn
    Stuijt, Jan
    Corradi, Federico
    Sifalakis, Manolis
    Konijnenburg, Mario
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 371 - 374
  • [10] Energy-efficient Amortized Inference with Cascaded Deep Classifiers
    Guan, Jiaqi
    Liu, Yang
    Liu, Qiang
    Peng, Jian
    [J]. PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 2184 - 2190