Brain connectivity meets reservoir computing

被引:24
|
作者
Damicelli, Fabrizio [1 ]
Hilgetag, Claus C. [1 ,2 ]
Goulas, Alexandros [1 ]
机构
[1] Hamburg Univ, Inst Computat Neurosci, Univ Med Ctr Hamburg Eppendorf, Hamburg, Germany
[2] Boston Univ, Dept Hlth Sci, Boston, MA 02215 USA
关键词
ORGANIZATION;
D O I
10.1371/journal.pcbi.1010639
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
The connectivity of Artificial Neural Networks (ANNs) is different from the one observed in Biological Neural Networks (BNNs). Can the wiring of actual brains help improve ANNs architectures? Can we learn from ANNs about what network features support computation in the brain when solving a task? At a meso/macro-scale level of the connectivity, ANNs' architectures are carefully engineered and such those design decisions have crucial importance in many recent performance improvements. On the other hand, BNNs exhibit complex emergent connectivity patterns at all scales. At the individual level, BNNs connectivity results from brain development and plasticity processes, while at the species level, adaptive reconfigurations during evolution also play a major role shaping connectivity. Ubiquitous features of brain connectivity have been identified in recent years, but their role in the brain's ability to perform concrete computations remains poorly understood. Computational neuroscience studies reveal the influence of specific brain connectivity features only on abstract dynamical properties, although the implications of real brain networks topologies on machine learning or cognitive tasks have been barely explored. Here we present a cross-species study with a hybrid approach integrating real brain connectomes and Bio-Echo State Networks, which we use to solve concrete memory tasks, allowing us to probe the potential computational implications of real brain connectivity patterns on task solving. We find results consistent across species and tasks, showing that biologically inspired networks perform as well as classical echo state networks, provided a minimum level of randomness and diversity of connections is allowed. We also present a framework, bio2art, to map and scale up real connectomes that can be integrated into recurrent ANNs. This approach also allows us to show the crucial importance of the diversity of interareal connectivity patterns, stressing the importance of stochastic processes determining neural networks connectivity in general. Author summary Artificial Neural Networks (ANNs) and Biological Neural Networks (BNNs) exhibit different connectivity patterns. ANNs' have tyically carefully hand-crafted architectures that play an important role in their performance. On the other hand, BNNs' wiring shows self-organized emergent patterns resulting from processes such as development and neuronal plasticity. Although ubiquitous properties of brain connectivity have beed identified and associated with abstract dynamical properties of the brain, the implications of real brain networks topologies on concrete machine learning tasks have been barely explored. The goal of this hybrid, cross-species study was to give a step in that direction by probing real brain connectomes on concrete machine learning tasks. Our approach integrates real brain connectomes and Bio-Echo State Networks, which we use to solve concrete memory tasks. To achieve that, we also present here a framework, bio2art, to map and scale up real connectomes that can be integrated into recurrent ANNs. We find results consistent across species and tasks, showing that biologically inspired networks perform as well as classical echo state networks, provided a minimum level of randomness and diversity of connections is allowed. Out findings stress the importance of stochasticity in neural networks connectivity, especially regarding the heterogeneity of interareal connectivity.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Reservoir computing quality: connectivity and topology
    Matthew Dale
    Simon O’Keefe
    Angelika Sebald
    Susan Stepney
    Martin A. Trefzer
    Natural Computing, 2021, 20 : 205 - 216
  • [2] Reservoir computing quality: connectivity and topology
    Dale, Matthew
    O'Keefe, Simon
    Sebald, Angelika
    Stepney, Susan
    Trefzer, Martin A.
    NATURAL COMPUTING, 2021, 20 (02) : 205 - 216
  • [3] Brain-Inspired Wireless Communications: Where Reservoir Computing Meets MIMO-OFDM
    Mosleh, Somayeh
    Liu, Lingjia
    Sahin, Cenk
    Zheng, Yahong Rosa
    Yi, Yang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (10) : 4694 - 4708
  • [4] Reservoir Computing meets Recurrent Kernels and Structured Transforms
    Dong, Jonathan
    Ohana, Ruben
    Rafayelyan, Mushegh
    Krzakala, Florent
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [5] Reservoir computing with brain organoids
    Smirnova, Lena
    Caffo, Brian
    Johnson, Erik C.
    NATURE ELECTRONICS, 2023, 6 (12) : 943 - 944
  • [6] Reservoir computing with brain organoids
    Lena Smirnova
    Brian Caffo
    Erik C. Johnson
    Nature Electronics, 2023, 6 : 943 - 944
  • [7] Functional connectivity analysis on hierarchical reservoir computing model
    Yonemura, Yoshihiro
    Katori, Yuichi
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2022, 13 (02): : 446 - 451
  • [8] Effects of Connectivity on Narrative Temporal Processing in Structured Reservoir Computing
    Dominey, Peter Ford
    Ellmore, Timothy M.
    Ventre-Dominey, Jocelyne
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [9] Connectivity, Dynamics, and Memory in Reservoir Computing with Binary and Analog Neurons
    Buesing, Lars
    Schrauwen, Benjamin
    Legenstein, Robert
    NEURAL COMPUTATION, 2010, 22 (05) : 1272 - 1311
  • [10] Brain organoid reservoir computing for artificial intelligence
    Cai, Hongwei
    Ao, Zheng
    Tian, Chunhui
    Wu, Zhuhao
    Liu, Hongcheng
    Tchieu, Jason
    Gu, Mingxia
    Mackie, Ken
    Guo, Feng
    NATURE ELECTRONICS, 2023, 6 (12) : 1032 - 1039