Cross-modal translation priming and iconicity effects in deaf signers and hearing learners of American Sign Language

被引:17
|
作者
Mott, Megan [1 ]
Midgley, Katherine J. [1 ]
Holcomb, Phillip J. [1 ]
Emmorey, Karen [2 ]
机构
[1] San Diego State Univ, Dept Psychol, San Diego, CA 92182 USA
[2] San Diego State Univ, Sch Speech Language & Hearing Sci, San Diego, CA 92182 USA
基金
美国国家卫生研究院;
关键词
translation recognition; sign language; iconicity; language learning; 2ND-LANGUAGE LEARNERS; TIME-COURSE; RECOGNITION; GESTURES; DATABASE; FORM;
D O I
10.1017/S1366728919000889
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
This study used ERPs to a) assess the neural correlates of cross-linguistic, cross-modal translation priming in hearing beginning learners of American Sign Language (ASL) and deaf highly proficient signers and b) examine whether sign iconicity modulates these priming effects. Hearing learners exhibited translation priming for ASL signs preceded by English words (greater negativity for unrelated than translation primes) later in the ERP waveform than deaf signers and exhibited earlier and greater priming for iconic than non-iconic signs. Iconicity did not modulate translation priming effects either behaviorally or in the ERPs for deaf signers (except in a 800-1000 ms time window). Because deaf signers showed early translation priming effects (beginning at 400ms-600ms), we suggest that iconicity did not facilitate lexical access, but deaf signers may have recognized sign iconicity later in processing. Overall, the results indicate that iconicity speeds lexical access for L2 sign language learners, but not for proficient signers.
引用
收藏
页码:1032 / 1044
页数:13
相关论文
共 50 条
  • [1] The effect of iconicity in the mental lexicon of hearing non-signers and proficient signers: evidence of cross-modal priming
    Ortega, Gerardo
    Morgan, Gary
    [J]. LANGUAGE COGNITION AND NEUROSCIENCE, 2015, 30 (05) : 574 - 585
  • [2] PERCEPTION OF ICONICITY IN AMERICAN SIGN LANGUAGE BY HEARING AND DEAF SUBJECTS
    GRIFFITH, PL
    ROBINSON, JH
    PANAGOS, JM
    [J]. JOURNAL OF SPEECH AND HEARING DISORDERS, 1981, 46 (04): : 388 - 397
  • [3] Cross-modal Neural Sign Language Translation
    Duarte, Amanda
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1650 - 1654
  • [4] Cross-Modal Attention Network for Sign Language Translation
    Gao, Liqing
    Wan, Liang
    Feng, Wei
    [J]. 2023 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW 2023, 2023, : 985 - 994
  • [5] Cortical representation of sign language:: Comparison of deaf signers and hearing non-signers
    Levänen, S
    Uutela, K
    Salenius, S
    Hari, R
    [J]. CEREBRAL CORTEX, 2001, 11 (06) : 506 - 512
  • [6] Conditional Sentence Generation and Cross-Modal Reranking for Sign Language Translation
    Zhao, Jian
    Qi, Weizhen
    Zhou, Wengang
    Duan, Nan
    Zhou, Ming
    Li, Houqiang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2662 - 2672
  • [7] Cross-modal iconicity and indexicality in the production of lexical sensory and emotional signs in Finnish Sign Language
    Keranen, Jarkko
    [J]. COGNITIVE LINGUISTICS, 2023, 34 (3-4) : 333 - 369
  • [8] Lending a hand to signed language acquisition: Enactment and iconicity enhance sign recall in hearing adult American Sign Language learners
    Morett, Laura M.
    [J]. JOURNAL OF COGNITIVE PSYCHOLOGY, 2015, 27 (03) : 251 - 276
  • [9] CONCEPTUAL CROSS-MODAL TRANSFER IN DEAF AND HEARING CHILDREN
    BLANK, M
    BRIDGER, WH
    [J]. CHILD DEVELOPMENT, 1966, 37 (01) : 29 - +
  • [10] Cross-Modal Recruitment of Auditory and Orofacial Areas During Sign Language in a Deaf Subject
    Martino, Juan
    Velasquez, Carlos
    Vazquez-Bourgon, Javier
    Marco de Lucas, Enrique
    Gomez, Elsa
    [J]. WORLD NEUROSURGERY, 2017, 105 : 1033.e1 - 1033.e5