Audio-visual integration in temporal perception

被引:76
|
作者
Wada, Y
Kitagawa, N
Noguchi, K
机构
[1] Nihon Univ, Dept Psychol, Setagaya Ku, Tokyo 1568550, Japan
[2] Tokyo Metropolitan Univ, Dept Psychol, Hachioji, Tokyo 1920397, Japan
关键词
audio-visual interaction; temporal perception; auditory flutter-driving of visual flicker; information reliability hypothesis;
D O I
10.1016/S0167-8760(03)00128-4
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In situations of audio-visual interaction, research has generally found that audition prevails over vision in temporal perception, while vision is dominant over audition for spatial perception. Modality appropriateness to a given task generally determines the direction of this inter-modality effect. However, we found a reverse effect in some situations where a change in the frequency of visual stimuli was associated with a perceived change in the frequency of auditory stimuli. In our experiment, 12 participants were asked to judge the change in the frequency of visual and auditory stimuli using a visual flicker and auditory flutter stimuli. In some conditions either the auditory or the visual information was ambiguous. In addition to confirming the expected finding that a change in the frequency of the auditory stimuli induced a perceived change in the frequency of the visual stimuli, we found a new phenomenon. When ambiguous auditory temporal cues were presented, the change in the frequency of the visual stimuli was associated with a perceived change in the frequency of the auditory stimuli. This suggests that cross-modal asymmetry effects are influenced by the reliability of visual and auditory information as well as modality appropriateness. (C) 2003 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:117 / 124
页数:8
相关论文
共 50 条
  • [1] Audio-visual integration in the perception of tap dancing
    Arrighi, R.
    Marini, F.
    Burr, D.
    [J]. PERCEPTION, 2007, 36 : 172 - 172
  • [2] Analysis of temporal perception for audio-visual stimulation
    Yu, Mi
    Lee, Sang-Min
    Piao, Yong-Jun
    Kwon, Tae-Kyu
    Kim, Nam-Gyun
    [J]. WORLD CONGRESS ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING 2006, VOL 14, PTS 1-6, 2007, 14 : 591 - +
  • [3] The Development of Audio-Visual Integration for Temporal Judgements
    Adams, Wendy J.
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2016, 12 (04)
  • [4] Audio-visual saliency prediction with multisensory perception and integration
    Xie, Jiawei
    Liu, Zhi
    Li, Gongyang
    Song, Yingjie
    [J]. IMAGE AND VISION COMPUTING, 2024, 143
  • [5] Audio-visual temporal perception in children with restored hearing
    Gori, Monica
    Chilosi, Anna
    Forli, Francesca
    Burr, David
    [J]. NEUROPSYCHOLOGIA, 2017, 99 : 350 - 359
  • [6] Transfer of Audio-Visual Temporal Training to Temporal and Spatial Audio-Visual Tasks
    Suerig, Ralf
    Bottari, Davide
    Roeder, Brigitte
    [J]. MULTISENSORY RESEARCH, 2018, 31 (06) : 556 - 578
  • [7] Experience-driven audio-visual integration in speech perception
    Stephens, J
    Holt, L
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, : 82 - 82
  • [8] Recalibration of temporal order perception by exposure to audio-visual asynchrony
    Vroomen, J
    Keetels, M
    de Gelder, B
    Bertelson, P
    [J]. COGNITIVE BRAIN RESEARCH, 2004, 22 (01): : 32 - 35
  • [9] Multimodal and Temporal Perception of Audio-visual Cues for Emotion Recognition
    Ghaleb, Esam
    Popa, Mirela
    Asteriadis, Stylianos
    [J]. 2019 8TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2019,
  • [10] The temporal dynamics of conscious and unconscious audio-visual semantic integration
    Gao, Mingjie
    Zhu, Weina
    Drewes, Jan
    [J]. HELIYON, 2024, 10 (13)