Rhythmicity and cross-modal temporal cues facilitate detection

被引:60
|
作者
ten Oever, Sanne [1 ]
Schroeder, Charles E. [2 ,3 ,4 ]
Poeppel, David [5 ]
van Atteveldt, Nienke [1 ,6 ,7 ]
Zion-Golumbic, Elana [2 ,3 ,4 ,8 ]
机构
[1] Maastricht Univ, Fac Psychol & Neurosci, NL-6200 MD Maastricht, Netherlands
[2] Columbia Univ, Med Ctr, Dept Psychiat, New York, NY 10032 USA
[3] Columbia Univ, Med Ctr, Dept Neurol, New York, NY 10032 USA
[4] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
[5] NYU, Dept Psychol, New York, NY 10003 USA
[6] Vrije Univ Amsterdam, Fac Psychol & Educ, Dept Educ Neurosci, Amsterdam, Netherlands
[7] Vrije Univ Amsterdam, Inst Learn, Amsterdam, Netherlands
[8] Bar Ilan Univ, Gonda Brain Res Ctr, Ramat Gan, Israel
关键词
Temporal prediction; Audiovisual integration; Rhythmicity; Detection; LOW-FREQUENCY OSCILLATIONS; NEURONAL OSCILLATIONS; MULTISENSORY INTEGRATION; AUDITORY DETECTION; VISUAL SPEECH; ATTENTION; DYNAMICS; RECALIBRATION; ENTRAINMENT; COMBINATION;
D O I
10.1016/j.neuropsychologia.2014.08.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Temporal structure in the environment often has predictive value for anticipating the occurrence of forthcoming events. In this study we investigated the influence of two types of predictive temporal information on the perception of near-threshold auditory stimuli: 1) intrinsic temporal rhythmicity within an auditory stimulus stream and 2) temporally-predictive visual cues. We hypothesized that combining predictive temporal information within- and across-modality should decrease the threshold at which sounds are detected, beyond the advantage provided by each information source alone. Two experiments were conducted in which participants had to detect tones in noise. Tones were presented in either rhythmic or random sequences and were preceded by a temporally predictive visual signal in half of the trials. We show that detection intensities are lower for rhythmic (vs. random) and audiovisual (vs. auditory-only) presentation, independent from response bias, and that this effect is even greater for rhythmic audiovisual presentation. These results suggest that both types of temporal information are used to optimally process sounds that occur at expected points in time (resulting in enhanced detection), and that multiple temporal cues are combined to improve temporal estimates. Our findings underscore the flexibility and proactivity of the perceptual system which uses within- and across-modality temporal cues to anticipate upcoming events and process them optimally. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:43 / 50
页数:8
相关论文
共 50 条
  • [21] Deep Structured Cross-Modal Anomaly Detection
    Li, Yuening
    Liu, Ninghao
    Li, Jundong
    Du, Mengnan
    Hu, Xia
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [22] Cross-Modal Object Detection Via UAV
    Li, Ang
    Ni, Shouxiang
    Chen, Yanan
    Chen, Jianxin
    Wei, Xin
    Zhou, Liang
    Guizani, Mohsen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10894 - 10905
  • [23] Is Cross-Modal Matching Necessary? A Bayesian Analysis of Individual Reference Cues
    Benz, Tobias Michael
    Nitsch, Verena
    HAPTICS: SCIENCE, TECHNOLOGY, AND APPLICATIONS, PT I, 2018, 10893 : 15 - 26
  • [24] Cross-modal and cross-temporal association in neurons of frontal cortex
    Joaquín M. Fuster
    Mark Bodner
    James K. Kroger
    Nature, 2000, 405 : 347 - 351
  • [25] Cross-modal and cross-temporal association in neurons of frontal cortex
    Fuster, JM
    Bodner, M
    Kroger, JK
    NATURE, 2000, 405 (6784) : 347 - 351
  • [26] Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Erasing Network
    Zhang, Zhicheng
    Wang, Lijuan
    Yang, Jufeng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18888 - 18897
  • [27] HCMSL: Hybrid Cross-modal Similarity Learning for Cross-modal Retrieval
    Zhang, Chengyuan
    Song, Jiayu
    Zhu, Xiaofeng
    Zhu, Lei
    Zhang, Shichao
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (01)
  • [28] Exploiting Temporal Dependencies for Cross-modal Music Piece Identification
    Carvalho, Luis
    Widmer, Gerhard
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 386 - 390
  • [29] Visual and auditory temporal processing, cross-modal transfer, and reading
    Rose, SA
    Feldman, JF
    Jankowski, JJ
    Futterweit, LR
    JOURNAL OF LEARNING DISABILITIES, 1999, 32 (03) : 256 - 266
  • [30] Temporal discrimination of cross-modal and unimodal stimuli in generalized dystonia
    Aglioti, SM
    Fiorio, M
    Forster, B
    Tinazzi, M
    NEUROLOGY, 2003, 60 (05) : 782 - 785