A role for cortical interneurons as adversarial discriminators

被引:0
|
作者
Benjamin, Ari S. [1 ]
Kording, Konrad P. [1 ]
机构
[1] Univ Penn, Dept Bioengn, Philadelphia, PA 19104 USA
关键词
LONG-TERM POTENTIATION; AUDITORY-CORTEX; INTERNAL-MODEL; SLEEP; OSCILLATIONS; GAMMA; THETA; CA1; ACETYLCHOLINE; MODULATION;
D O I
10.1371/journal.pcbi.1011484
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
The brain learns representations of sensory information from experience, but the algorithms by which it does so remain unknown. One popular theory formalizes representations as inferred factors in a generative model of sensory stimuli, meaning that learning must improve this generative model and inference procedure. This framework underlies many classic computational theories of sensory learning, such as Boltzmann machines, the Wake/Sleep algorithm, and a more recent proposal that the brain learns with an adversarial algorithm that compares waking and dreaming activity. However, in order for such theories to provide insights into the cellular mechanisms of sensory learning, they must be first linked to the cell types in the brain that mediate them. In this study, we examine whether a subtype of cortical interneurons might mediate sensory learning by serving as discriminators, a crucial component in an adversarial algorithm for representation learning. We describe how such interneurons would be characterized by a plasticity rule that switches from Hebbian plasticity during waking states to anti-Hebbian plasticity in dreaming states. Evaluating the computational advantages and disadvantages of this algorithm, we find that it excels at learning representations in networks with recurrent connections but scales poorly with network size. This limitation can be partially addressed if the network also oscillates between evoked activity and generative samples on faster timescales. Consequently, we propose that an adversarial algorithm with interneurons as discriminators is a plausible and testable strategy for sensory learning in biological systems. After raw sensory data is received at the periphery, it is transformed by various neural pathways and delivered to the sensory cortex. There, neural activity forms an internal model of the state of the external world, which is updated appropriately by new information. A goal of learning, then, is to learn how to transform information into the appropriate representational form within the brain's internal model. Here, we look to artificial intelligence for new possible theories of how the brain might learn representations that resolve issues with previously proposed theories. We describe how one particular algorithm-adversarial learning-resolves a major issue with previous hypotheses relating to recurrence. Furthermore, this algorithm resembles broad features of the organization and learning dynamics of the brain, such as wake and sleep cycles. Considering seriously how this algorithm would appear if implemented by the brain, we map its features to known physiology and make testable predictions for how neural circuits learn new representations of information.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] The Role of Robo3 in the Development of Cortical Interneurons
    Barber, Melissa
    Di Meglio, Thomas
    Andrews, William D.
    Hernandez-Miranda, Luis R.
    Murakami, Fujio
    Chedotal, Alain
    Parnavelas, John G.
    CEREBRAL CORTEX, 2009, 19 : I22 - I31
  • [2] A role for Mash1 in specification of cortical interneurons
    Casarosa, S
    Fode, C
    Guillemot, F
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2000, 12 : 262 - 262
  • [3] Detection of Adversarial DDoS Attacks Using Generative Adversarial Networks with Dual Discriminators
    Shieh, Chin-Shiuh
    Nguyen, Thanh-Tuan
    Lin, Wan-Wei
    Huang, Yong-Lin
    Horng, Mong-Fong
    Lee, Tsair-Fwu
    Miu, Denis
    SYMMETRY-BASEL, 2022, 14 (01):
  • [4] Diversity of Cortical Interneurons in Primates: The Role of the Dorsal Proliferative Niche
    Radonjic, Nevena V.
    Ayoub, Albert E.
    Memi, Fani
    Yu, Xiaojing
    Maroof, Asif
    Jakovcevski, Igor
    Anderson, Stewart A.
    Rakic, Pasko
    Zecevic, Nada
    CELL REPORTS, 2014, 9 (06): : 2139 - 2151
  • [5] A crucial role of polysialic acid in developmental migration of cortical interneurons
    Diederichs, Ute
    Kroecher, Tim
    Roeckle, Iris
    Yanagawa, Yuchio
    Weinhold, Birgit
    Hildebrandt, Herbert
    GLYCOBIOLOGY, 2014, 24 (11) : 1176 - 1176
  • [6] The plasticitome of cortical interneurons
    McFarlan, Amanda R.
    Chou, Christina Y. C.
    Watanabe, Airi
    Cherepacha, Nicole
    Haddad, Maria
    Owens, Hannah
    Sjostrom, P. Jesper
    NATURE REVIEWS NEUROSCIENCE, 2023, 24 (02) : 80 - 97
  • [7] Cortical interneurons and their origins
    Wonders, C
    Anderson, SA
    NEUROSCIENTIST, 2005, 11 (03): : 199 - 205
  • [8] The plasticitome of cortical interneurons
    Amanda R. McFarlan
    Christina Y. C. Chou
    Airi Watanabe
    Nicole Cherepacha
    Maria Haddad
    Hannah Owens
    P. Jesper Sjöström
    Nature Reviews Neuroscience, 2023, 24 : 80 - 97
  • [9] Cortical interneurons in autism
    Anis Contractor
    Iryna M. Ethell
    Carlos Portera-Cailliau
    Nature Neuroscience, 2021, 24 : 1648 - 1659
  • [10] Development of Cortical Interneurons
    Chu, Jianhua
    Anderson, Stewart A.
    NEUROPSYCHOPHARMACOLOGY, 2015, 40 (01) : 16 - 23