Brain connectivity meets reservoir computing

被引:24
|
作者
Damicelli, Fabrizio [1 ]
Hilgetag, Claus C. [1 ,2 ]
Goulas, Alexandros [1 ]
机构
[1] Hamburg Univ, Inst Computat Neurosci, Univ Med Ctr Hamburg Eppendorf, Hamburg, Germany
[2] Boston Univ, Dept Hlth Sci, Boston, MA 02215 USA
关键词
ORGANIZATION;
D O I
10.1371/journal.pcbi.1010639
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
The connectivity of Artificial Neural Networks (ANNs) is different from the one observed in Biological Neural Networks (BNNs). Can the wiring of actual brains help improve ANNs architectures? Can we learn from ANNs about what network features support computation in the brain when solving a task? At a meso/macro-scale level of the connectivity, ANNs' architectures are carefully engineered and such those design decisions have crucial importance in many recent performance improvements. On the other hand, BNNs exhibit complex emergent connectivity patterns at all scales. At the individual level, BNNs connectivity results from brain development and plasticity processes, while at the species level, adaptive reconfigurations during evolution also play a major role shaping connectivity. Ubiquitous features of brain connectivity have been identified in recent years, but their role in the brain's ability to perform concrete computations remains poorly understood. Computational neuroscience studies reveal the influence of specific brain connectivity features only on abstract dynamical properties, although the implications of real brain networks topologies on machine learning or cognitive tasks have been barely explored. Here we present a cross-species study with a hybrid approach integrating real brain connectomes and Bio-Echo State Networks, which we use to solve concrete memory tasks, allowing us to probe the potential computational implications of real brain connectivity patterns on task solving. We find results consistent across species and tasks, showing that biologically inspired networks perform as well as classical echo state networks, provided a minimum level of randomness and diversity of connections is allowed. We also present a framework, bio2art, to map and scale up real connectomes that can be integrated into recurrent ANNs. This approach also allows us to show the crucial importance of the diversity of interareal connectivity patterns, stressing the importance of stochastic processes determining neural networks connectivity in general. Author summary Artificial Neural Networks (ANNs) and Biological Neural Networks (BNNs) exhibit different connectivity patterns. ANNs' have tyically carefully hand-crafted architectures that play an important role in their performance. On the other hand, BNNs' wiring shows self-organized emergent patterns resulting from processes such as development and neuronal plasticity. Although ubiquitous properties of brain connectivity have beed identified and associated with abstract dynamical properties of the brain, the implications of real brain networks topologies on concrete machine learning tasks have been barely explored. The goal of this hybrid, cross-species study was to give a step in that direction by probing real brain connectomes on concrete machine learning tasks. Our approach integrates real brain connectomes and Bio-Echo State Networks, which we use to solve concrete memory tasks. To achieve that, we also present here a framework, bio2art, to map and scale up real connectomes that can be integrated into recurrent ANNs. We find results consistent across species and tasks, showing that biologically inspired networks perform as well as classical echo state networks, provided a minimum level of randomness and diversity of connections is allowed. Out findings stress the importance of stochasticity in neural networks connectivity, especially regarding the heterogeneity of interareal connectivity.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Task computing - The semantic web meets pervasive computing
    Masuoka, R
    Parsia, B
    Labrou, Y
    SEMANTIC WEB - ISWC 2003, 2003, 2870 : 866 - 881
  • [32] Reservoir computing with noise
    Nathe, Chad
    Pappu, Chandra
    Mecholsky, Nicholas A.
    Hart, Joe
    Carroll, Thomas
    Sorrentino, Francesco
    CHAOS, 2023, 33 (04)
  • [33] Multifunctional reservoir computing
    Du, Yao
    Luo, Haibo
    Guo, Jianmin
    Xiao, Jinghua
    Yu, Yizhen
    Wang, Xingang
    PHYSICAL REVIEW E, 2025, 111 (03)
  • [34] Reservoir computing with memristors
    不详
    NATURE ELECTRONICS, 2022, 5 (10) : 623 - 623
  • [35] Reservoir computing with solitons
    Silva, Nuno Azevedo
    Ferreira, Tiago D.
    Guerreiro, Ariel
    NEW JOURNAL OF PHYSICS, 2021, 23 (02):
  • [36] Reservoir computing with swarms
    Lymburn, Thomas
    Algar, Shannon D.
    Small, Michael
    Jungling, Thomas
    CHAOS, 2021, 31 (03)
  • [37] Differentiable reservoir computing
    Grigoryeva, Lyudmila
    Ortega, Juan-Pablo
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [38] Reservoir computing on the hypersphere
    Andrecut, M.
    INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2017, 28 (07):
  • [39] Reservoir Computing Trends
    Lukoševičius, Mantas
    Jaeger, Herbert
    Schrauwen, Benjamin
    KI - Kunstliche Intelligenz, 2012, 26 (04): : 365 - 371
  • [40] Memcapacitive Reservoir Computing
    Tran, Dat S. J.
    Teuscher, Christof
    PROCEEDINGS OF THE IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH 2017), 2017, : 115 - 116