Seeing the initial articulatory gestures of a word triggers lexical access

被引:34
|
作者
Fort, Mathilde [1 ]
Kandel, Sonia [1 ,2 ,3 ]
Chipot, Justine [1 ]
Savariaux, Christophe [3 ]
Granjon, Lionel [3 ]
Spinelli, Elsa [1 ,2 ,4 ]
机构
[1] Univ Pierre Mendes France, Lab Psychol & NeuroCognit, CNRS UMR 5105, F-38040 Grenoble 9, France
[2] Inst Univ France, Paris, France
[3] Univ Grenoble 3, CNRS UMR 5216, Dpt Parole & Cognit, GIPSA Lab, F-38040 Grenoble 9, France
[4] Univ Calif Berkeley, Berkeley, CA 94720 USA
来源
LANGUAGE AND COGNITIVE PROCESSES | 2013年 / 28卷 / 08期
关键词
Visual speech; Lexical access; Phonological priming; Lexical frequency; AUDITORY WORD; VISUAL SPEECH; SPOKEN WORDS; TIME-COURSE; RECOGNITION; COMPETITION; DISTINCTIVENESS; CONTEXT; MODEL; CUES;
D O I
10.1080/01690965.2012.701758
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
When the auditory information is deteriorated by noise in a conversation, watching the face of a speaker enhances speech intelligibility. Recent findings indicate that decoding the facial movements of a speaker accelerates word recognition. The objective of this study was to provide evidence that the mere presentation of the first two phonemesthat is, the articulatory gestures of the initial syllableis enough visual information to activate a lexical unit and initiate the lexical access process. We used a priming paradigm combined with a lexical decision task. The primes were syllables that either shared the initial syllable with an auditory target or not. In Experiment 1, the primes were displayed in audiovisual, auditory-only or visual-only conditions. There was a priming effect in all conditions. Experiment 2 investigated the locus (prelexical vs. lexical or postlexical) of the facilitation effect observed in the visual-only condition by manipulating the target's word frequency. The facilitation produced by the visual prime was significant for low-frequency words but not for high-frequency words, indicating that the locus of the effect is not prelexical. This suggests that visual speech mostly contributes to the word recognition process when lexical access is difficult.
引用
收藏
页码:1207 / 1223
页数:17
相关论文
共 50 条
  • [1] Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues
    Bujok, Ronny
    Meyer, Antje S.
    Bosker, Hans Rutger
    [J]. LANGUAGE AND SPEECH, 2024,
  • [2] Seeing the mouth: the importance of articulatory gestures during phonics training
    Novelli, Christina
    Ardoin, Scott P.
    Rodgers, Derek B.
    [J]. READING AND WRITING, 2023,
  • [3] Robust Word Recognition using articulatory trajectories and Gestures
    Mitra, Vikramjit
    Nam, Hosung
    Espy-Wilson, Carol
    Saltzman, Elliot
    Goldstein, Louis
    [J]. 11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 3 AND 4, 2010, : 2038 - +
  • [4] Word for word: Multiple lexical access in speech production
    Levelt, WJM
    Meyer, AS
    [J]. EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2000, 12 (04): : 433 - 452
  • [5] The Effect of Word Frequency and Lexical Class on Articulatory-Acoustic Coupling
    Yang, Zhaojun
    Ramanarayanan, Vikram
    Byrd, Dani
    Narayanan, Shrikanth S.
    [J]. 14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 973 - 977
  • [6] Articulatory coordination in word-initial clusters of German
    Bombien, Lasse
    Mooshammer, Christine
    Hoole, Philip
    [J]. JOURNAL OF PHONETICS, 2013, 41 (06) : 546 - 561
  • [7] Movement and lexical access: Do noniconic gestures aid in retrieval?
    Susan Ravizza
    [J]. Psychonomic Bulletin & Review, 2003, 10 : 610 - 615
  • [8] Movement and lexical access: Do noniconic gestures aid in retrieval?
    Ravizza, S
    [J]. PSYCHONOMIC BULLETIN & REVIEW, 2003, 10 (03) : 610 - 615
  • [9] LEXICAL ACCESS DURING EYE FIXATIONS IN READING - EFFECTS OF WORD-INITIAL LETTER SEQUENCE
    LIMA, SD
    INHOFF, AW
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1985, 11 (03) : 272 - 285
  • [10] PHONOLOGY, LEXICAL ACCESS IN READING, AND ARTICULATORY SUPPRESSION - A CRITICAL-REVIEW
    BESNER, D
    [J]. QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION A-HUMAN EXPERIMENTAL PSYCHOLOGY, 1987, 39 (03): : 467 - 478