Brain-inspired wiring economics for artificial neural networks

被引:0
|
作者
Zhang, Xin-Jie [1 ,2 ]
Moore, Jack Murdoch [1 ,2 ]
Gao, Ting-Ting [1 ,2 ]
Zhang, Xiaozhu [1 ,2 ,3 ,4 ]
Yan, Gang [1 ,2 ,5 ]
机构
[1] Tongji Univ, Sch Phys Sci & Engn, Shanghai 200092, Peoples R China
[2] Tongji Univ, MOE Frontiers Sci Ctr Intelligent Autonomous Syst, Natl Key Lab Autonomous Intelligent Unmanned Syst, Shanghai 200092, Peoples R China
[3] Tech Univ Dresden, Chair Network Dynam, Ctr Adv Elect Dresden cfaed, D-01062 Dresden, Germany
[4] Tech Univ Dresden, Inst Theoret Phys, D-01062 Dresden, Germany
[5] Chinese Acad Sci, CAS Ctr Excellence Brain Sci & Intelligence Techno, Shanghai 200031, Peoples R China
来源
PNAS NEXUS | 2025年 / 4卷 / 01期
基金
中国国家自然科学基金;
关键词
wiring cost; brain-like computing; interpretable AI; bio-inspired AI; sparse neural networks; CONNECTIVITY; OPTIMIZATION; MODULARITY; REGRESSION;
D O I
10.1093/pnasnexus/pgae580
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Wiring patterns of brain networks embody a trade-off between information transmission, geometric constraints, and metabolic cost, all of which must be balanced to meet functional needs. Geometry and wiring economy are crucial in the development of brains, but their impact on artificial neural networks (ANNs) remains little understood. Here, we adopt a wiring cost-controlled training framework that simultaneously optimizes wiring efficiency and task performance during structural evolution of sparse ANNs whose nodes are located at arbitrary but fixed positions. We show that wiring cost control improves performance across a wide range of tasks, ANN architectures and training methods, and can promote task-specific structural modules. An optimal wiring cost range provides both enhanced predictive performance and high values of topological properties, such as modularity and clustering, which are observed in real brain networks and known to improve robustness, interpretability, and performance of ANNs. In addition, ANNs trained using wiring cost can emulate the connection distance distribution observed in the brains of real organisms (such as Ciona intestinalis and Caenorhabditis elegans), especially when achieving high task performance, offering insights into biological organizing principles. Our results shed light on the relationship between topology and task specialization of ANNs trained within biophysical constraints, and their geometric resemblance to real neuronal-level brain maps.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Memory-Augmented Graph Neural Networks: A Brain-Inspired Review
    Ma G.
    Vo V.A.
    Willke T.L.
    Ahmed N.K.
    IEEE Transactions on Artificial Intelligence, 5 (05): : 2011 - 2025
  • [22] A Brain-Inspired Causal Reasoning Model Based on Spiking Neural Networks
    Fang, Hongjian
    Zeng, Yi
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [23] Brain-inspired artificial intelligence research: A review
    Wang, GuoYin
    Bao, HuaNan
    Liu, Qun
    Zhou, TianGang
    Wu, Si
    Huang, TieJun
    Yu, ZhaoFei
    Lu, CeWu
    Gong, YiHong
    Zhang, ZhaoXiang
    He, Sheng
    SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2024, 67 (08) : 2282 - 2296
  • [24] Brain-inspired artificial intelligence research: A review
    WANG GuoYin
    BAO HuaNan
    LIU Qun
    ZHOU TianGang
    WU Si
    HUANG TieJun
    YU ZhaoFei
    LU CeWu
    GONG YiHong
    ZHANG ZhaoXiang
    HE Sheng
    Science China(Technological Sciences), 2024, 67 (08) : 2282 - 2296
  • [25] Toward a Brain-Inspired Theory of Artificial Learning
    Thivierge, J. P.
    Giraud, Eloise
    Lynn, Michael
    COGNITIVE COMPUTATION, 2024, 16 (05) : 2374 - 2381
  • [26] Recent Advances in Smart Tactile Sensory Systems with Brain-Inspired Neural Networks
    Lee, Junho
    Kwak, Jee Young
    Keum, Kyobin
    Sik Kim, Kang
    Kim, Insoo
    Lee, Myung-Jae
    Kim, Yong-Hoon
    Park, Sung Kyu
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (04)
  • [27] Predify: Augmenting deep neural networks with brain-inspired predictive coding dynamics
    Choksi, Bhavin
    Mozafari, Milad
    O'May, Callum Biggs
    Ador, Benjamin
    Alamia, Andrea
    VanRullen, Rufin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [28] Brain-inspired computing: can 2D materials bridge the gap between biological and artificial neural networks?
    Singh, Deependra Kumar
    Gupta, Govind
    MATERIALS ADVANCES, 2024, 5 (08): : 3158 - 3172
  • [29] Memristive Devices and Networks for Brain-Inspired Computing
    Zhang, Teng
    Yang, Ke
    Xu, Xiaoyan
    Cai, Yimao
    Yang, Yuchao
    Huang, Ru
    PHYSICA STATUS SOLIDI-RAPID RESEARCH LETTERS, 2019, 13 (08):
  • [30] Brain-Inspired Communications in Dense Wireless Networks
    Kulacz, Lukasz
    Kliks, Adrian
    2018 14TH INTERNATIONAL CONFERENCE ON MOBILE AD-HOC AND SENSOR NETWORKS (MSN 2018), 2018, : 140 - 145