Convolutional neural networks reveal properties of reach-to-grasp encoding in posterior parietal cortex

被引:3
|
作者
Borra D. [1 ]
Filippini M. [3 ]
Ursino M. [1 ,2 ]
Fattori P. [2 ,3 ]
Magosso E. [1 ,2 ]
机构
[1] Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi” (DEI), University of Bologna, Cesena Campus, Cesena
[2] Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna
[3] Department of Biomedical and Neuromotor Sciences (DIBINEM), University of Bologna, Bologna
基金
欧盟地平线“2020”;
关键词
Convolutional neural networks; Explainable artificial intelligence; Layer-wise relevance propagation; Macaque; Reach-to-grasping; Single-neuron recordings; V6A area;
D O I
10.1016/j.compbiomed.2024.108188
中图分类号
学科分类号
摘要
Deep neural networks (DNNs) are widely adopted to decode motor states from both non-invasively and invasively recorded neural signals, e.g., for realizing brain-computer interfaces. However, the neurophysiological interpretation of how DNNs make the decision based on the input neural activity is limitedly addressed, especially when applied to invasively recorded data. This reduces decoder reliability and transparency, and prevents the exploitation of decoders to better comprehend motor neural encoding. Here, we adopted an explainable artificial intelligence approach – based on a convolutional neural network and an explanation technique – to reveal spatial and temporal neural properties of reach-to-grasping from single-neuron recordings of the posterior parietal area V6A. The network was able to accurately decode 5 different grip types, and the explanation technique automatically identified the cells and temporal samples that most influenced the network prediction. Grip encoding in V6A neurons already started at movement preparation, peaking during movement execution. A difference was found within V6A: dorsal V6A neurons progressively encoded more for increasingly advanced grips, while ventral V6A neurons for increasingly rudimentary grips, with both subareas following a linear trend between the amount of grip encoding and the level of grip skills. By revealing the elements of the neural activity most relevant for each grip with no a priori assumptions, our approach supports and advances current knowledge about reach-to-grasp encoding in V6A, and it may represent a general tool able to investigate neural correlates of motor or cognitive tasks (e.g., attention and memory tasks) from single-neuron recordings. © 2024 The Authors
引用
收藏
相关论文
共 50 条
  • [11] Neurons in Primary Motor Cortex Encode Hand Orientation in a Reach-to-Grasp Task
    Chaolin Ma
    Xuan Ma
    Jing Fan
    Jiping He
    Neuroscience Bulletin, 2017, 33 : 383 - 395
  • [12] Neural encoding of actual and imagined touch within human posterior parietal cortex
    Chivukula, Srinivas
    Zhang, Carey Y.
    Aflalo, Tyson
    Jafari, Matiar
    Pejsa, Kelsie
    Pouratian, Nader
    Andersen, Richard A.
    ELIFE, 2021, 10
  • [13] Neurons in Primary Motor Cortex Encode Hand Orientation in a Reach-to-Grasp Task
    Ma, Chaolin
    Ma, Xuan
    Fan, Jing
    He, Jiping
    NEUROSCIENCE BULLETIN, 2017, 33 (04) : 383 - 395
  • [14] Neurons in Primary Motor Cortex Encode Hand Orientation in a Reach-to-Grasp Task
    Chaolin Ma
    Xuan Ma
    Jing Fan
    Jiping He
    Neuroscience Bulletin, 2017, 33 (04) : 383 - 395
  • [15] Specialization of reach function in human posterior parietal cortex
    Michael Vesia
    J. Douglas Crawford
    Experimental Brain Research, 2012, 221 : 1 - 18
  • [16] Specialization of reach function in human posterior parietal cortex
    Vesia, Michael
    Crawford, J. Douglas
    EXPERIMENTAL BRAIN RESEARCH, 2012, 221 (01) : 1 - 18
  • [17] How to Reach: Movement Planning in the Posterior Parietal Cortex
    Petzschner, Frederike H.
    Krueger, Melanie
    JOURNAL OF NEUROSCIENCE, 2012, 32 (14): : 4703 - 4704
  • [18] Encoding of Coordinated Reach and Grasp Trajectories in Primary Motor Cortex
    Saleh, Maryam
    Takahashi, Kazutaka
    Hatsopoulos, Nicholas G.
    JOURNAL OF NEUROSCIENCE, 2012, 32 (04): : 1220 - 1232
  • [19] Motor cortical encoding of hand orientation in a 3-D reach-to-grasp task
    Fan, Jing
    He, Jiping
    2006 28TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-15, 2006, : 4299 - +
  • [20] Primary motor cortex neuronal discharge during reach-to-grasp: Controlling the hand as a unit
    Mason, CR
    Gomez, JE
    Ebner, TJ
    ARCHIVES ITALIENNES DE BIOLOGIE, 2002, 140 (03): : 229 - 236