Convolutional neural networks reveal properties of reach-to-grasp encoding in posterior parietal cortex

被引:3
|
作者
Borra D. [1 ]
Filippini M. [3 ]
Ursino M. [1 ,2 ]
Fattori P. [2 ,3 ]
Magosso E. [1 ,2 ]
机构
[1] Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi” (DEI), University of Bologna, Cesena Campus, Cesena
[2] Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna
[3] Department of Biomedical and Neuromotor Sciences (DIBINEM), University of Bologna, Bologna
基金
欧盟地平线“2020”;
关键词
Convolutional neural networks; Explainable artificial intelligence; Layer-wise relevance propagation; Macaque; Reach-to-grasping; Single-neuron recordings; V6A area;
D O I
10.1016/j.compbiomed.2024.108188
中图分类号
学科分类号
摘要
Deep neural networks (DNNs) are widely adopted to decode motor states from both non-invasively and invasively recorded neural signals, e.g., for realizing brain-computer interfaces. However, the neurophysiological interpretation of how DNNs make the decision based on the input neural activity is limitedly addressed, especially when applied to invasively recorded data. This reduces decoder reliability and transparency, and prevents the exploitation of decoders to better comprehend motor neural encoding. Here, we adopted an explainable artificial intelligence approach – based on a convolutional neural network and an explanation technique – to reveal spatial and temporal neural properties of reach-to-grasping from single-neuron recordings of the posterior parietal area V6A. The network was able to accurately decode 5 different grip types, and the explanation technique automatically identified the cells and temporal samples that most influenced the network prediction. Grip encoding in V6A neurons already started at movement preparation, peaking during movement execution. A difference was found within V6A: dorsal V6A neurons progressively encoded more for increasingly advanced grips, while ventral V6A neurons for increasingly rudimentary grips, with both subareas following a linear trend between the amount of grip encoding and the level of grip skills. By revealing the elements of the neural activity most relevant for each grip with no a priori assumptions, our approach supports and advances current knowledge about reach-to-grasp encoding in V6A, and it may represent a general tool able to investigate neural correlates of motor or cognitive tasks (e.g., attention and memory tasks) from single-neuron recordings. © 2024 The Authors
引用
收藏
相关论文
共 50 条
  • [1] Posterior parietal cortex control of reach-to-grasp movements in humans
    Chapman, H
    Gavrilescu, M
    Wang, H
    Kean, M
    Egan, G
    Castiello, U
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2002, 15 (12) : 2037 - 2042
  • [2] Neural coordination during reach-to-grasp
    Vaidya, Mukta
    Kording, Konrad
    Saleh, Maryam
    Takahashi, Kazutaka
    Hatsopoulos, Nicholas G.
    JOURNAL OF NEUROPHYSIOLOGY, 2015, 114 (03) : 1827 - 1836
  • [3] Analysis of Neural Interaction in Motor Cortex during Reach-to-grasp Task based on Dynamic Bayesian Networks
    Sang, Dong
    Lv, Bin
    He, Huiguang
    He, Jiping
    Wang, Feiyue
    2010 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2010, : 4140 - 4143
  • [4] Analyzing Neural Interaction Characteristics in a Monkey's Motor Cortex during Reach-to-Grasp Tasks
    Sang, Dong
    Lv, Bin
    He, Huiguang
    Wen, Ding
    He, Jiping
    IEEE INTELLIGENT SYSTEMS, 2011, 26 (05) : 64 - 71
  • [5] Predicting Identity-Preserving Object Transformations in Human Posterior Parietal Cortex and Convolutional Neural Networks
    Mocz, Viola
    Vaziri-Pashkam, Maryam
    Chun, Marvin
    Xu, Yaoda
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2022, 34 (12) : 2406 - 2435
  • [6] Predicting Hand Orientation in Reach-to-grasp Tasks Using Neural Activities from Primary Motor Cortex
    Zhang, Peng
    Ma, Xuan
    Huang, Hailong
    He, Jiping
    2014 36TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2014, : 1306 - 1309
  • [7] Evaluating Neural Interaction in Motor Cortex during Reach-to-grasp Task from the Spike Train Data
    Lv, Bin
    Sang, Dong
    He, Huiguang
    Wang, Feiyue
    He, Jiping
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS, VOLS 1-4, 2009, : 624 - +
  • [8] Hand Orientation during Reach-to-Grasp Movements Modulates Neuronal Activity in the Medial Posterior Parietal Area V6A
    Fattori, Patrizia
    Breveglieri, Rossella
    Marzocchi, Nicoletta
    Filippini, Daniela
    Bosco, Annalisa
    Galletti, Claudio
    JOURNAL OF NEUROSCIENCE, 2009, 29 (06): : 1928 - 1936
  • [9] A Bayesian-Optimized Convolutional Neural Network to Decode Reach-to-Grasp from Macaque Dorsomedial Visual Stream
    Borra, Davide
    Filippini, Matteo
    Ursino, Mauro
    Fattori, Patrizia
    Magosso, Elisa
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2022, PT II, 2023, 13811 : 473 - 487
  • [10] The posterior parietal area V6A: An attentionally-modulated visuomotor region involved in the control of reach-to-grasp action
    Galletti, Claudio
    Gamberini, Michela
    Fattori, Patrizia
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2022, 141