Rhythmicity and cross-modal temporal cues facilitate detection

被引:60
|
作者
ten Oever, Sanne [1 ]
Schroeder, Charles E. [2 ,3 ,4 ]
Poeppel, David [5 ]
van Atteveldt, Nienke [1 ,6 ,7 ]
Zion-Golumbic, Elana [2 ,3 ,4 ,8 ]
机构
[1] Maastricht Univ, Fac Psychol & Neurosci, NL-6200 MD Maastricht, Netherlands
[2] Columbia Univ, Med Ctr, Dept Psychiat, New York, NY 10032 USA
[3] Columbia Univ, Med Ctr, Dept Neurol, New York, NY 10032 USA
[4] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
[5] NYU, Dept Psychol, New York, NY 10003 USA
[6] Vrije Univ Amsterdam, Fac Psychol & Educ, Dept Educ Neurosci, Amsterdam, Netherlands
[7] Vrije Univ Amsterdam, Inst Learn, Amsterdam, Netherlands
[8] Bar Ilan Univ, Gonda Brain Res Ctr, Ramat Gan, Israel
关键词
Temporal prediction; Audiovisual integration; Rhythmicity; Detection; LOW-FREQUENCY OSCILLATIONS; NEURONAL OSCILLATIONS; MULTISENSORY INTEGRATION; AUDITORY DETECTION; VISUAL SPEECH; ATTENTION; DYNAMICS; RECALIBRATION; ENTRAINMENT; COMBINATION;
D O I
10.1016/j.neuropsychologia.2014.08.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Temporal structure in the environment often has predictive value for anticipating the occurrence of forthcoming events. In this study we investigated the influence of two types of predictive temporal information on the perception of near-threshold auditory stimuli: 1) intrinsic temporal rhythmicity within an auditory stimulus stream and 2) temporally-predictive visual cues. We hypothesized that combining predictive temporal information within- and across-modality should decrease the threshold at which sounds are detected, beyond the advantage provided by each information source alone. Two experiments were conducted in which participants had to detect tones in noise. Tones were presented in either rhythmic or random sequences and were preceded by a temporally predictive visual signal in half of the trials. We show that detection intensities are lower for rhythmic (vs. random) and audiovisual (vs. auditory-only) presentation, independent from response bias, and that this effect is even greater for rhythmic audiovisual presentation. These results suggest that both types of temporal information are used to optimally process sounds that occur at expected points in time (resulting in enhanced detection), and that multiple temporal cues are combined to improve temporal estimates. Our findings underscore the flexibility and proactivity of the perceptual system which uses within- and across-modality temporal cues to anticipate upcoming events and process them optimally. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:43 / 50
页数:8
相关论文
共 50 条
  • [31] Cross-modal decoupling in temporal attention between audition and touch
    Stefanie Mühlberg
    Salvador Soto-Faraco
    Psychological Research, 2019, 83 : 1626 - 1639
  • [32] Cross-modal decoupling in temporal attention between audition and touch
    Muhlberg, Stefanie
    Soto-Faraco, Salvador
    PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 2019, 83 (08): : 1626 - 1639
  • [33] Cross-Modal Adaptation for RGB-D Detection
    Hoffman, Judy
    Gupta, Saurabh
    Leong, Jian
    Guadarrama, Sergio
    Darrell, Trevor
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2016, : 5032 - 5039
  • [34] Deception and deception detection: The role of cross-modal inconsistency
    Heinrich, CU
    Borkenau, P
    JOURNAL OF PERSONALITY, 1998, 66 (05) : 687 - 712
  • [35] Cascaded Cross-Modal Transformer for Request and Complaint Detection
    Ristea, Nicolae-Catalin
    Ionescu, Radu Tudor
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 9467 - 9471
  • [36] Cross-modal information fusion for voice spoofing detection
    Xue, Junxiao
    Zhou, Hao
    Song, Huawei
    Wu, Bin
    Shi, Lei
    SPEECH COMMUNICATION, 2023, 147 : 41 - 50
  • [37] MMCSC:A Cross-Modal Approach to Fake News Detection
    Zhao Y.
    Hao K.
    Zhao J.
    Xin J.-C.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2024, 45 (01): : 18 - 25
  • [38] Assessing cross-modal interference in the detection response task
    Thorpe, Alexander
    Innes, Reilly
    Townsend, James
    Heath, Rachel
    Nesbitt, Keith
    Eidels, Ami
    JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2020, 98
  • [39] Auditory Attention Detection via Cross-Modal Attention
    Cai, Siqi
    Li, Peiwen
    Su, Enze
    Xie, Longhan
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [40] Cross-Modal Object Detection Based on a Knowledge Update
    Gao, Yueqing
    Zhou, Huachun
    Chen, Lulu
    Shen, Yuting
    Guo, Ce
    Zhang, Xinyu
    SENSORS, 2022, 22 (04)