Cross-Modal Object Recognition Is Viewpoint-Independent

被引:50
|
作者
Lacey, Simon [1 ]
Peters, Andrew [1 ]
Sathian, K. [1 ,2 ,3 ,4 ]
机构
[1] Emory Univ, Dept Neurol, Atlanta, GA 30322 USA
[2] Emory Univ, Dept Rehabil Med, Atlanta, GA 30322 USA
[3] Emory Univ, Dept Psychol, Atlanta, GA 30322 USA
[4] Atlanta Vet Affairs Med Ctr, Rehabil Res & Dev Ctr Excellence, Decatur, GA USA
来源
PLOS ONE | 2007年 / 2卷 / 09期
基金
美国国家科学基金会;
关键词
D O I
10.1371/journal.pone.0000890
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Background. Previous research suggests that visual and haptic object recognition are viewpoint-dependent both within- and cross-modally. However, this conclusion may not be generally valid as it was reached using objects oriented along their extended y-axis, resulting in differential surface processing in vision and touch. In the present study, we removed this differential by presenting objects along the z-axis, thus making all object surfaces more equally available to vision and touch. Methodology/Principal Findings. Participants studied previously unfamiliar objects, in groups of four, using either vision or touch. Subsequently, they performed a four-alternative forced-choice object identification task with the studied objects presented in both unrotated and rotated (180 degrees about the x-, y-, and z-axes) orientations. Rotation impaired within-modal recognition accuracy in both vision and touch, but not cross- modal recognition accuracy. Within-modally, visual recognition accuracy was reduced by rotation about the x- and y- axes more than the z-axis, whilst haptic recognition was equally affected by rotation about all three axes. Cross-modal (but not within-modal) accuracy correlated with spatial (but not object) imagery scores. Conclusions/Significance. The viewpoint-independence of cross- modal object identification points to its mediation by a high-level abstract representation. The correlation between spatial imagery scores and cross- modal performance suggest that construction of this high-level representation is linked to the ability to perform spatial transformations. Within-modal viewpoint-dependence appears to have a different basis in vision than in touch, possibly due to surface occlusion being important in vision but not touch.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Dysgranular retrosplenial cortex lesions in rats disrupt cross-modal object recognition
    Hindley, Emma L.
    Nelson, Andrew J. D.
    Aggleton, John P.
    Vann, Seralynne D.
    LEARNING & MEMORY, 2014, 21 (03) : 171 - 179
  • [22] HAPTIC AND CROSS-MODAL RECOGNITION IN CHILDREN
    BUSHNELL, EW
    BULLETIN OF THE PSYCHONOMIC SOCIETY, 1991, 29 (06) : 499 - 499
  • [23] Cross-Modal Distillation for Speaker Recognition
    Jin, Yufeng
    Hu, Guosheng
    Chen, Haonan
    Miao, Duoqian
    Hu, Liang
    Zhao, Cairong
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 12977 - 12985
  • [24] CROSS-MODAL RECOGNITION IN CHIMPANZEES AND MONKEYS
    JARVIS, MJ
    ETTLINGER, G
    NEUROPSYCHOLOGIA, 1977, 15 (4-5) : 499 - 506
  • [25] Cross-modal attention and letter recognition
    Wesner, Michael
    Miller, Lisa
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2008, 43 (3-4) : 343 - 343
  • [26] CHILDRENS RECOGNITION OF CROSS-MODAL SIMILARITY
    MARKS, LE
    BORNSTEIN, MH
    CAHIERS DE PSYCHOLOGIE COGNITIVE-CURRENT PSYCHOLOGY OF COGNITION, 1985, 5 (3-4): : 322 - 322
  • [27] CROSS-MODAL RECOGNITION IN 3 PRIMATES
    ELLIOTT, RC
    NEUROPSYCHOLOGIA, 1977, 15 (01) : 183 - 186
  • [28] Viewpoint-independent object class detection using 3D feature maps
    Liebelt, Joerg
    Schmid, Cordelia
    Schertler, Klaus
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 2118 - +
  • [29] Object Segmentation by Mining Cross-Modal Semantics
    Wu, Zongwei
    Wang, Jingjing
    Zhou, Zhuyun
    An, Zhaochong
    Jiang, Qiuping
    Demonceaux, Cedric
    Sun, Guolei
    Timofte, Radu
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3455 - 3464
  • [30] Cross-Modal Object Detection Via UAV
    Li, Ang
    Ni, Shouxiang
    Chen, Yanan
    Chen, Jianxin
    Wei, Xin
    Zhou, Liang
    Guizani, Mohsen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10894 - 10905