THE VISUAL ENCODING OF TOOL-OBJECT AFFORDANCES

被引:23
|
作者
Natraj, N. [1 ]
Pella, Y. M. [1 ]
Borghi, A. M. [2 ,3 ]
Wheaton, L. A. [1 ]
机构
[1] Georgia Inst Technol, Sch Appl Physiol, Coll Sci, Cognit Motor Control Lab, Atlanta, GA 30332 USA
[2] Univ Bologna, Dept Psychol, I-40126 Bologna, Italy
[3] Italian Natl Res Council, Inst Cognit Sci & Technol, I-00185 Rome, Italy
关键词
affordances; tool; action; eye movement; perception; pattern recognition; EYE-MOVEMENTS; CORTICAL CONTROL; CONSEQUENCES; ACTIVATION; COMPONENTS; ATTENTION; DYNAMICS; SACCADES; SYSTEM; HAND;
D O I
10.1016/j.neuroscience.2015.09.060
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The perception of tool-object pairs involves understanding their action-relationships (affordances). Here, we sought to evaluate how an observer visually encodes tool-object affordances. Eye-movements were recorded as right-handed participants freely viewed static, right-handed, egocentric tool-object images across three contexts: correct (e.g. hammer-nail), incorrect (e.g. hammer-paper), spatial/ambiguous (e.g. hammer-wood), and three grasp-types: no hand, functional grasp-posture (grasp hammer-handle), non-functional/manipulative grasp-posture (grasp hammer-head). There were three areas of interests (AOI): the object (nail), the operant tool-end (hammer-head), the graspable tool-end (hammer-handle). Participants passively evaluated whether tool-object pairs were functionally correct/incorrect. Clustering of gaze scanpaths and AOI weightings grouped conditions into three distinct grasp-specific clusters, especially across correct and spatial tool-object contexts and to a lesser extent within the incorrect tool-object context. The grasp-specific gaze scanpath clusters were reasonably robust to the temporal order of gaze scanpaths. Gaze was therefore automatically primed to grasp-affordances though the task required evaluating tool-object context. Participants also primarily focused on the object and the operant tool-end and sparsely attended to the graspable tool-end, even in images with functional grasp-postures. In fact, in the absence of a grasp, the object was foveally weighted the most, indicative of a possible object-oriented action priming effect wherein the observer may be evaluating how the tool engages on the object. Unlike the functional grasp-posture, the manipulative grasp-posture caused the greatest disruption in the object-oriented priming effect, ostensibly as it does not afford tool-object action due to its non-functional interaction with the operant tool-end that actually engages with the object (e.g., hammer-head to nail). The enhanced attention towards the manipulative graspposture may serve to encode grasp-intent. Results here shed new light on how an observer gathers action-information when evaluating static tool-object scenes and reveal how contextual and grasp-specific affordances directly modulate visuospatial attention. (C) 2015 IBRO. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:512 / 527
页数:16
相关论文
共 50 条
  • [41] Tool use and function knowledge shape visual object processing
    Foerster, Francois R.
    Goslin, Jeremy
    [J]. BIOLOGICAL PSYCHOLOGY, 2021, 164
  • [42] Exploring affordances and tool use on the iCub
    Tikhanoff, V.
    Pattacini, U.
    Natale, L.
    Metta, G.
    [J]. 2013 13TH IEEE-RAS INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS), 2013, : 130 - 137
  • [43] Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons
    Zheng, Yajing
    Li, Shixin
    Yan, Rui
    Tang, Huajin
    Tan, Kay Chen
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (12) : 5823 - 5833
  • [44] Detecting Object Affordances with Convolutional Neural Networks
    Anh Nguyen
    Kanoulas, Dimitrios
    Caldwell, Darwin G.
    Tsagarakis, Nikos G.
    [J]. 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), 2016, : 2765 - 2770
  • [45] Object-based encoding in visual working memory: A life span study
    Zhang, Qiong
    Shen, Mowei
    Tang, Ning
    Zhao, Guohua
    Gao, Zaifeng
    [J]. JOURNAL OF VISION, 2013, 13 (10):
  • [46] Evidence for the Role of Motor Affordances in Object Memory
    Lagace, Sebastien
    Guerard, Katherine
    [J]. CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2014, 68 (04): : 293 - 293
  • [47] Recognizing Object Affordances in Terms of Spatio-Temporal Object-Object Relationships
    Pieropan, Alessandro
    Ek, Carl Henrik
    Kjellstrom, Hedvig
    [J]. 2014 14TH IEEE-RAS INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS), 2014, : 52 - 58
  • [48] Affordances and inertial constraints on tool use
    Wagman, JB
    Carello, C
    [J]. ECOLOGICAL PSYCHOLOGY, 2001, 13 (03) : 173 - 195
  • [49] Apraxia of tool use is not a matter of affordances
    Osiurak, Francois
    [J]. FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
  • [50] Relational affordances for multiple-object manipulation
    Moldovan, Bogdan
    Moreno, Plinio
    Nitti, Davide
    Santos-Victor, Jose
    De Raedt, Luc
    [J]. AUTONOMOUS ROBOTS, 2018, 42 (01) : 19 - 44