Neurobiological Causal Models of Language Processing

被引:0
|
作者
Fitz, Hartmut [1 ,2 ]
Hagoort, Peter [1 ,2 ]
Petersson, Karl Magnus [2 ,3 ]
机构
[1] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
[2] Max Planck Inst Psycholinguist, Neurobiol Language Dept, Nijmegen, Netherlands
[3] Univ Algarve, Fac Med & Biomed Sci, Faro, Portugal
来源
NEUROBIOLOGY OF LANGUAGE | 2024年 / 5卷 / 01期
关键词
adaptive dynamical systems; computational modeling; implementational causality; neurobiology of language; processing memory; COMPUTATIONAL PRINCIPLES; SENTENCE COMPREHENSION; TEMPORAL INTEGRATION; NEURAL-NETWORKS; MEMORY; NEUROSCIENCE; PLASTICITY; BRAIN; DYNAMICS; SYNTAX;
D O I
10.1162/nol_a_00133
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
The language faculty is physically realized in the neurobiological infrastructure of the human brain. Despite significant efforts, an integrated understanding of this system remains a formidable challenge. What is missing from most theoretical accounts is a specification of the neural mechanisms that implement language function. Computational models that have been put forward generally lack an explicit neurobiological foundation. We propose a neurobiologically informed causal modeling approach which offers a framework for how to bridge this gap. A neurobiological causal model is a mechanistic description of language processing that is grounded in, and constrained by, the characteristics of the neurobiological substrate. It intends to model the generators of language behavior at the level of implementational causality. We describe key features and neurobiological component parts from which causal models can be built and provide guidelines on how to implement them in model simulations. Then we outline how this approach can shed new light on the core computational machinery for language, the long-term storage of words in the mental lexicon and combinatorial processing in sentence comprehension. In contrast to cognitive theories of behavior, causal models are formulated in the "machine language" of neurobiology which is universal to human cognition. We argue that neurobiological causal modeling should be pursued in addition to existing approaches. Eventually, this approach will allow us to develop an explicit computational neurobiology of language.
引用
收藏
页码:225 / 247
页数:23
相关论文
共 50 条
  • [1] Specific language impairment: Definitions, causal mechanisms, and neurobiological factors
    Ahmed, ST
    Lombardino, LJ
    Leonard, CM
    [J]. JOURNAL OF MEDICAL SPEECH-LANGUAGE PATHOLOGY, 2001, 9 (01) : 1 - 15
  • [2] Causal Distillation for Language Models
    Wu, Zhengxuan
    Geiger, Atticus
    Rozner, Joshua
    Kreiss, Elisa
    Lu, Hanson
    Icard, Thomas
    Potts, Christopher
    Goodman, Noah
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 4288 - 4295
  • [3] Models of Language Processing
    Abel, Ihre Stefanie
    [J]. SPRACHE-STIMME-GEHOR, 2011, 35 (01): : 7 - 7
  • [4] Causal Dataset Discovery with Large Language Models
    Liu, Junfei
    Sun, Shaotong
    Nargesian, Fatemeh
    [J]. WORKSHOP ON HUMAN-IN-THE-LOOP DATA ANALYTICS, HILDA 2024, 2024,
  • [5] CLADDER: Assessing Causal Reasoning in Language Models
    Jin, Zhijing
    Chen, Yuen
    Leeb, Felix
    Gresele, Luigi
    Kamal, Ojasv
    Lyu, Zhiheng
    Blin, Kevin
    Gonzalez, Fernando
    Kleiman-Weiner, Max
    Sachan, Mrinmaya
    Schoelkopf, Bernhard
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [6] COMPUTATIONAL MODELS OF LANGUAGE PROCESSING
    STABLER, EP
    [J]. BEHAVIORAL AND BRAIN SCIENCES, 1986, 9 (03) : 550 - 551
  • [7] Models and modularity in language processing
    Dell, GS
    [J]. PROCEEDINGS OF THE EIGHTEENTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, 1996, : 47 - 47
  • [8] Neurocomputational Models of Language Processing
    Hale, John T.
    Campanelli, Luca
    Li, Jixing
    Bhattasali, Shohini
    Pallier, Christophe
    Brennan, Jonathan R.
    [J]. ANNUAL REVIEW OF LINGUISTICS, 2022, 8 : 427 - 446
  • [9] Accelerating materials language processing with large language models
    Jaewoong Choi
    Byungju Lee
    [J]. Communications Materials, 5
  • [10] THE ROLE OF MODELS OF LANGUAGE PROCESSING IN REHABILITATION OF LANGUAGE IMPAIRMENTS
    HILLIS, AE
    [J]. APHASIOLOGY, 1993, 7 (01) : 5 - 26