Integration of Audiovisual Speech and Priming Effects

被引:0
|
作者
Ali, Azra N. [1 ]
机构
[1] Univ Huddersfield, Sch Comp & Engn, Huddersfield HD1 3DH, W Yorkshire, England
关键词
Speech perception; McGurk effect; Priming;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Humans report fusion /da/ when presented with audio /ba/ aligned with visual /ga/. Over the last three decades most researchers have neglected the velar McGurk fusion: audio /ba/ with visual /da/ eliciting /ga/ fusion, and audio /pa/ with visual /ta/ resulting in /ka/ fusion. Cathiard [1], claimed that these latter types of fusion are laboratory curiosities which do not occur embedded in French VCV syllables. We conduct two experiments; in the first experiment, incongruent segment is embedded in real English words and in the second experiment we use a priming approach to bias the perception towards either the audio channel or the visual or the expected fusion. Results show that velar fusion perceptions are not just a product of isolated nonsense syllables, but are robust percepts formed by integration of audio and visual channels. Thus, using both types of McGurk fusion has potential to be used as a probing tool for exploring the phonological organization of lexical entities.
引用
收藏
页码:2044 / 2047
页数:4
相关论文
共 50 条
  • [1] A measure for assessing the effects of audiovisual speech integration
    Nicholas Altieri
    James T. Townsend
    Michael J. Wenger
    [J]. Behavior Research Methods, 2014, 46 : 406 - 415
  • [2] A measure for assessing the effects of audiovisual speech integration
    Altieri, Nicholas
    Townsend, James T.
    Wenger, Michael J.
    [J]. BEHAVIOR RESEARCH METHODS, 2014, 46 (02) : 406 - 415
  • [3] Psychophysics of the McGurk and Other Audiovisual Speech Integration Effects
    Jiang, Jintao
    Bernstein, Lynne E.
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2011, 37 (04) : 1193 - 1209
  • [4] THE COHERENCE OF SPEECH IN AUDIOVISUAL INTEGRATION
    ABRY, C
    CATHIARD, MA
    ROBERTRIBES, J
    SCHWARTZ, JL
    [J]. CAHIERS DE PSYCHOLOGIE COGNITIVE-CURRENT PSYCHOLOGY OF COGNITION, 1994, 13 (01): : 52 - 59
  • [5] Effects of age and left hemisphere lesions on audiovisual integration of speech
    Michaelis, Kelly
    Erickson, Laura C.
    Fama, Mackenzie E.
    Skipper-Kallal, Laura M.
    Xing, Shihui
    Lacey, Elizabeth H.
    Anbari, Zainab
    Norato, Gina
    Rauschecker, Josef P.
    Turkeltaub, Peter E.
    [J]. BRAIN AND LANGUAGE, 2020, 206
  • [6] Audiovisual temporal integration of speech and gesture
    Margiotoudi, Konstantina
    Kelly, Spencer
    Vatakis, Argiro
    [J]. INTERNATIONAL CONFERENCE ON TIMING AND TIME PERCEPTION, 2014, 126 : 154 - +
  • [7] Automatic audiovisual integration in speech perception
    Gentilucci, M
    Cattaneo, L
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2005, 167 (01) : 66 - 75
  • [8] Audiovisual Integration of Speech in a Bistable Illusion
    Munhall, K. G.
    ten Hove, M. W.
    Brammer, M.
    Pare, M.
    [J]. CURRENT BIOLOGY, 2009, 19 (09) : 735 - 739
  • [9] Automatic audiovisual integration in speech perception
    Maurizio Gentilucci
    Luigi Cattaneo
    [J]. Experimental Brain Research, 2005, 167 : 66 - 75
  • [10] HOW SPECIAL IS AUDIOVISUAL SPEECH INTEGRATION
    ROSENBLUM, LD
    [J]. CAHIERS DE PSYCHOLOGIE COGNITIVE-CURRENT PSYCHOLOGY OF COGNITION, 1994, 13 (01): : 110 - 116