Brain-inspired wiring economics for artificial neural networks

被引:0
|
作者
Zhang, Xin-Jie [1 ,2 ]
Moore, Jack Murdoch [1 ,2 ]
Gao, Ting-Ting [1 ,2 ]
Zhang, Xiaozhu [1 ,2 ,3 ,4 ]
Yan, Gang [1 ,2 ,5 ]
机构
[1] Tongji Univ, Sch Phys Sci & Engn, Shanghai 200092, Peoples R China
[2] Tongji Univ, MOE Frontiers Sci Ctr Intelligent Autonomous Syst, Natl Key Lab Autonomous Intelligent Unmanned Syst, Shanghai 200092, Peoples R China
[3] Tech Univ Dresden, Chair Network Dynam, Ctr Adv Elect Dresden cfaed, D-01062 Dresden, Germany
[4] Tech Univ Dresden, Inst Theoret Phys, D-01062 Dresden, Germany
[5] Chinese Acad Sci, CAS Ctr Excellence Brain Sci & Intelligence Techno, Shanghai 200031, Peoples R China
来源
PNAS NEXUS | 2025年 / 4卷 / 01期
基金
中国国家自然科学基金;
关键词
wiring cost; brain-like computing; interpretable AI; bio-inspired AI; sparse neural networks; CONNECTIVITY; OPTIMIZATION; MODULARITY; REGRESSION;
D O I
10.1093/pnasnexus/pgae580
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Wiring patterns of brain networks embody a trade-off between information transmission, geometric constraints, and metabolic cost, all of which must be balanced to meet functional needs. Geometry and wiring economy are crucial in the development of brains, but their impact on artificial neural networks (ANNs) remains little understood. Here, we adopt a wiring cost-controlled training framework that simultaneously optimizes wiring efficiency and task performance during structural evolution of sparse ANNs whose nodes are located at arbitrary but fixed positions. We show that wiring cost control improves performance across a wide range of tasks, ANN architectures and training methods, and can promote task-specific structural modules. An optimal wiring cost range provides both enhanced predictive performance and high values of topological properties, such as modularity and clustering, which are observed in real brain networks and known to improve robustness, interpretability, and performance of ANNs. In addition, ANNs trained using wiring cost can emulate the connection distance distribution observed in the brains of real organisms (such as Ciona intestinalis and Caenorhabditis elegans), especially when achieving high task performance, offering insights into biological organizing principles. Our results shed light on the relationship between topology and task specialization of ANNs trained within biophysical constraints, and their geometric resemblance to real neuronal-level brain maps.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Brain-inspired replay for continual learning with artificial neural networks
    Gido M. van de Ven
    Hava T. Siegelmann
    Andreas S. Tolias
    Nature Communications, 11
  • [2] Brain-inspired replay for continual learning with artificial neural networks
    van de Ven, Gido M.
    Siegelmann, Hava T.
    Tolias, Andreas S.
    NATURE COMMUNICATIONS, 2020, 11 (01)
  • [3] Deep Learning in Spiking Neural Networks for Brain-Inspired Artificial intelligence
    Kasabov, Nikola
    COMPUTER SYSTEMS AND TECHNOLOGIES (COMPSYSTECH'18), 2018, 1641 : 1 - 1
  • [4] Brain-Inspired Architecture for Spiking Neural Networks
    Tang, Fengzhen
    Zhang, Junhuai
    Zhang, Chi
    Liu, Lianqing
    BIOMIMETICS, 2024, 9 (10)
  • [5] Brain-inspired neural circuit evolution for spiking neural networks
    Shen, Guobin
    Zhao, Dongcheng
    Dong, Yiting
    Zeng, Yi
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2023, 120 (39)
  • [6] Brain-inspired multimodal learning based on neural networks
    Chang Liu
    Fuchun Sun
    Bo Zhang
    BrainScienceAdvances, 2018, 4 (01) : 61 - 72
  • [7] Advancing brain-inspired computing with hybrid neural networks
    Liu, Faqiang
    Zheng, Hao
    Ma, Songchen
    Zhang, Weihao
    Liu, Xue
    Chua, Yansong
    Shi, Luping
    Zhao, Rong
    NATIONAL SCIENCE REVIEW, 2024, 11 (05)
  • [8] Advancing brain-inspired computing with hybrid neural networks
    Faqiang Liu
    Hao Zheng
    Songchen Ma
    Weihao Zhang
    Xue Liu
    Yansong Chua
    Luping Shi
    Rong Zhao
    National Science Review, 2024, 11 (05) : 56 - 71
  • [9] Optimizing information processing in brain-inspired neural networks
    Paprocki, B.
    Pregowska, A.
    Szczepanski, J.
    BULLETIN OF THE POLISH ACADEMY OF SCIENCES-TECHNICAL SCIENCES, 2020, 68 (02) : 225 - 233
  • [10] Brain-inspired Evolutionary Architectures for Spiking Neural Networks
    Pan W.
    Zhao F.
    Zhao Z.
    Zeng Y.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (11): : 1 - 10