On-Beat/Off-Beat Visual Responses to Audio-Visual Asynchrony in Music Videos

被引:0
|
作者
Swenberg, Thorbjorn [1 ]
Carlgren, Simon [1 ]
机构
[1] Dalarna Univ, Moving Image Prod Dept, Falun, Sweden
关键词
audio-visual asynchrony; audio-visual rhythm; audio-visual synchrony; cueing; eye-tracking; music video; COGNITIVE LOAD; SYNCHRONY PERCEPTION; EXPRESS SACCADES; EYE-MOVEMENTS; REACTION-TIME; INTEGRATION; ATTENTION; CONTINUITY; RHYTHMS; TASK;
D O I
10.3167/proj.2021.150103
中图分类号
J9 [电影、电视艺术]; I235 [电影、电视、广播剧];
学科分类号
摘要
Audio-visual rhythm can be achieved in a variety of ways, in film as well as in music videos. Here, we have studied human visual responses to video editing with regard to musical beats, in order to better understand the role of visual rhythm in an audio-visual flow. While some suggest that music videos should maintain synchrony in the audio-visual rhythm, and others claim that music videos should be rhythmically loose in their structure, there is a functional aspect of vision and hearing that reacts to the juxtaposition of audio and visual rhythms. We present empirical evidence of cognitive effects, as well as perceptual differences with attentional effects, for viewers watching music videos cut on-beat and off-beat.
引用
收藏
页码:28 / 54
页数:27
相关论文
共 50 条
  • [1] AUDIO-VISUAL DEMONSTRATION OF THE FETAL HEART BEAT
    LEHNDORFF, PG
    [J]. ANESTHESIOLOGY, 1960, 21 (01) : 106 - 106
  • [2] Rate limits of on-beat and off-beat tapping with simple auditory rhythms: 1. Qualitative observations
    Repp, BH
    [J]. MUSIC PERCEPTION, 2005, 22 (03): : 479 - 496
  • [3] Rate limits of on-beat and off-beat tapping with simple auditory rhythms: 2. The roles of different kinds of accent
    Repp, BH
    [J]. MUSIC PERCEPTION, 2005, 23 (02): : 165 - 187
  • [4] Audio-visual speech experience with age influences perceived audio-visual asynchrony in speech
    [J]. Alm, M. (magnus.alm@svt.ntnu.no), 1600, Acoustical Society of America (134):
  • [5] Audio-visual speech experience with age influences perceived audio-visual asynchrony in speech
    Alm, Magnus
    Behne, Dawn
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2013, 134 (04): : 3001 - 3010
  • [6] Audio-Visual Beat Tracking Based on a State-Space Model for a Music Robot Dancing with Humans
    Ohkita, Misato
    Bando, Yoshiaki
    Ikemiya, Yukara
    Itoyama, Katsutoshi
    Yoshii, Kazuyoshi
    [J]. 2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 5555 - 5560
  • [7] Particle-filter Based Audio-visual Beat-tracking for Music Robot Ensemble with Human Guitarist
    Itohara, Tatsuhiko
    Otsuka, Takuma
    Mizumoto, Takeshi
    Ogata, Tetsuya
    Okuno, Hiroshi G.
    [J]. 2011 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2011, : 118 - 124
  • [8] Audio-Visual Speech Asynchrony Modeling in a Talking Head
    Karpov, Alexey
    Tsirulnik, Liliya
    Krnoul, Zdenek
    Ronzhin, Andrey
    Lobanov, Boris
    Zelezny, Milos
    [J]. INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 2883 - +
  • [9] Audio-Visual Event Localization in Unconstrained Videos
    Tian, Yapeng
    Shi, Jing
    Li, Bochen
    Duan, Zhiyao
    Xu, Chenliang
    [J]. COMPUTER VISION - ECCV 2018, PT II, 2018, 11206 : 252 - 268
  • [10] Subliminal audio-visual temporal congruency in music videos enhances perceptual pleasure
    Lin, Chenyang
    Yeh, Maggie
    Shams, Ladan
    [J]. NEUROSCIENCE LETTERS, 2022, 779