Convolutional neural networks reveal properties of reach-to-grasp encoding in posterior parietal cortex

被引:3
|
作者
Borra D. [1 ]
Filippini M. [3 ]
Ursino M. [1 ,2 ]
Fattori P. [2 ,3 ]
Magosso E. [1 ,2 ]
机构
[1] Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi” (DEI), University of Bologna, Cesena Campus, Cesena
[2] Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna
[3] Department of Biomedical and Neuromotor Sciences (DIBINEM), University of Bologna, Bologna
基金
欧盟地平线“2020”;
关键词
Convolutional neural networks; Explainable artificial intelligence; Layer-wise relevance propagation; Macaque; Reach-to-grasping; Single-neuron recordings; V6A area;
D O I
10.1016/j.compbiomed.2024.108188
中图分类号
学科分类号
摘要
Deep neural networks (DNNs) are widely adopted to decode motor states from both non-invasively and invasively recorded neural signals, e.g., for realizing brain-computer interfaces. However, the neurophysiological interpretation of how DNNs make the decision based on the input neural activity is limitedly addressed, especially when applied to invasively recorded data. This reduces decoder reliability and transparency, and prevents the exploitation of decoders to better comprehend motor neural encoding. Here, we adopted an explainable artificial intelligence approach – based on a convolutional neural network and an explanation technique – to reveal spatial and temporal neural properties of reach-to-grasping from single-neuron recordings of the posterior parietal area V6A. The network was able to accurately decode 5 different grip types, and the explanation technique automatically identified the cells and temporal samples that most influenced the network prediction. Grip encoding in V6A neurons already started at movement preparation, peaking during movement execution. A difference was found within V6A: dorsal V6A neurons progressively encoded more for increasingly advanced grips, while ventral V6A neurons for increasingly rudimentary grips, with both subareas following a linear trend between the amount of grip encoding and the level of grip skills. By revealing the elements of the neural activity most relevant for each grip with no a priori assumptions, our approach supports and advances current knowledge about reach-to-grasp encoding in V6A, and it may represent a general tool able to investigate neural correlates of motor or cognitive tasks (e.g., attention and memory tasks) from single-neuron recordings. © 2024 The Authors
引用
收藏
相关论文
共 50 条
  • [21] Eye position encoding in the macaque posterior parietal cortex
    Bremmer, F
    Pouget, A
    Hoffmann, KP
    EUROPEAN JOURNAL OF NEUROSCIENCE, 1998, 10 (01) : 153 - 160
  • [22] A neural network model for a view independent extraction of reach-to-grasp action features
    Prevete, Roberto
    Santoro, Matteo
    Catanzariti, Ezio
    Tessitore, Giovanni
    ADVANCES IN BRAIN, VISION, AND ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2007, 4729 : 124 - +
  • [23] ENCODING OF INTENTION AND SPATIAL LOCATION IN THE POSTERIOR PARIETAL CORTEX
    ANDERSEN, RA
    CEREBRAL CORTEX, 1995, 5 (05) : 457 - 469
  • [24] Motor decoding from the posterior parietal cortex using deep neural networks
    Borra, Davide
    Filippini, Matteo
    Ursino, Mauro
    Fattori, Patrizia
    Magosso, Elisa
    JOURNAL OF NEURAL ENGINEERING, 2023, 20 (03)
  • [25] Spatiotemporal Distribution of Location and Object Effects in Primary Motor Cortex Neurons during Reach-to-Grasp
    Rouse, Adam G.
    Schieber, Marc H.
    JOURNAL OF NEUROSCIENCE, 2016, 36 (41): : 10640 - 10653
  • [26] Modulation of reach-to-grasp parameters: semantic category, volumetric properties and distracter interference?
    Kritikos, A
    Dunai, J
    Castiello, U
    EXPERIMENTAL BRAIN RESEARCH, 2001, 138 (01) : 54 - 61
  • [27] Massively parallel recordings in macaque motor cortex during an instructed delayed reach-to-grasp task
    Thomas Brochier
    Lyuba Zehl
    Yaoyao Hao
    Margaux Duret
    Julia Sprenger
    Michael Denker
    Sonja Grün
    Alexa Riehle
    Scientific Data, 5
  • [28] Modulation of reach-to-grasp parameters: semantic category, volumetric properties and distractor interference?
    Ada Kritikos
    Judy Dunai
    Umberto Castiello
    Experimental Brain Research, 2001, 138 : 54 - 61
  • [29] Neural population dynamics in motor cortex are different for reach and grasp
    Suresh, Aneesha K.
    Goodman, James M.
    Okorokova, Elizaveta, V
    Kaufman, Matthew
    Hatsopoulos, Nicholas G.
    Bensmaia, Sliman J.
    ELIFE, 2020, 9 : 1 - 16
  • [30] An investigation of the neural circuits underlying reaching and reach-to-grasp movements: from planning to execution
    Begliomini, Chiara
    De Sanctis, Teresa
    Marangon, Mattia
    Tarantino, Vincenza
    Sartori, Luisa
    Miotto, Diego
    Motta, Raffaella
    Stramare, Roberto
    Castiello, Umberto
    FRONTIERS IN HUMAN NEUROSCIENCE, 2014, 8