Sight-reading expertise: Cross-modality integration investigated using eye tracking

被引:37
|
作者
Drai-Zerbib, Veronique [1 ]
Baccino, Thierry [2 ]
Bigand, Emmanuel [3 ]
机构
[1] Univ Nice Sophia Antipolis, Dept Psychol, LASMIC, F-06357 Nice, France
[2] Univ Paris 08, F-93526 St Denis 02, France
[3] Univ Bourgogne, F-21004 Dijon, France
关键词
cross-modality; expertise; eye movements; psychology of music; sight-reading; AUDITORY IMAGERY; MUSICAL NOTATION; PERCEPTUAL SPAN; HAND SPAN; MOVEMENTS; MEMORY; PIANO; PERFORMANCE; MUSICIANS; PIANISTS;
D O I
10.1177/0305735610394710
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
It is often said that experienced musicians are capable of hearing what they read (and vice versa). This suggests that they are able to process and to integrate multimodal information. The present study investigates this issue with an eye-tracking technique. Two groups of musicians chosen on the basis of their level of expertise (experts, non-experts) had to read excerpts of poorly-known classical piano music and play them on a keyboard. The experiment was run in two consecutive phases during which each excerpt was (1) read without playing and (2) sight-read (read and played). In half the conditions, the participants heard the music before the reading phases. The excerpts contained suggested fingering of variable difficulty (difficult, easy, or no fingering). Analyses of first-pass fixation duration, second-pass fixation duration, probability of re-fixation, and playing mistakes validated the hypothesized modal independence of information among expert musicians as compared to non-experts. The results are discussed in terms of the processing cues and retrieval structures postulated by Ericsson and Kintsch (1995) in their model of expert memory.
引用
收藏
页码:216 / 235
页数:20
相关论文
共 50 条
  • [31] Image manipulation localization via dynamic cross-modality fusion and progressive integration
    Jin, Xiao
    Yu, Wen
    Shi, Wei
    [J]. NEUROCOMPUTING, 2024, 610
  • [32] Cross-modality integration framework with prediction, perception and discrimination for video anomaly detection
    Li, Chaobo
    Li, Hongjun
    Zhang, Guoan
    [J]. NEURAL NETWORKS, 2024, 172
  • [33] LOCAL CROSS-MODALITY IMAGE ALIGNMENT USING UNSUPERVISED LEARNING
    BERNANDER, O
    KOCH, C
    [J]. LECTURE NOTES IN COMPUTER SCIENCE, 1990, 427 : 573 - 575
  • [34] Coral Classification Using DenseNet and Cross-modality Transfer Learning
    Xu, Lian
    Bennamoun, Mohammed
    Boussaid, Farid
    Ana, Senjian
    Sohel, Ferdous
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [35] Expertise in action: An eye-tracking investigation of golf green reading
    Campbell, M.
    Moran, A.
    [J]. PERCEPTION, 2011, 40 : 111 - 111
  • [36] Cross-Modality Image Registration Using a Training-Time Privileged Third Modality
    Yang, Qianye
    Atkinson, David
    Fu, Yunguan
    Syer, Tom
    Yan, Wen
    Punwani, Shonit
    Clarkson, Matthew J.
    Barratt, Dean C.
    Vercauteren, Tom
    Hu, Yipeng
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (11) : 3421 - 3431
  • [37] Robust RGB-T Tracking via Adaptive Modality Weight Correlation Filters and Cross-modality Learning
    Zhou, Mingliang
    Zhao, Xinwen
    Luo, Futing
    Luo, Jun
    Pu, Huayan
    Xiang, Tao
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (04)
  • [38] CIRNet: An improved RGBT tracking via cross-modality interaction and re-identification
    Xia, Weidai
    Zhou, Dongming
    Cao, Jinde
    Liu, Yanyu
    Hou, Ruichao
    [J]. Neurocomputing, 2022, 493 : 327 - 339
  • [39] Sight-reading in skilled pianists: Eye-hand span is independent of practice but associated with the musicians' cognitive abilities
    Rosemann, S.
    Altenmueller, E.
    Trenner, D.
    Fahle, M.
    [J]. PERCEPTION, 2013, 42 : 133 - 133
  • [40] Deep Cross-Modality and Resolution Graph Integration for Universal Brain Connectivity Mapping and Augmentation
    Cinar, Ece
    Haseki, Sinem Elif
    Bessadok, Alaa
    Rekik, Islem
    [J]. IMAGING SYSTEMS FOR GI ENDOSCOPY, AND GRAPHS IN BIOMEDICAL IMAGE ANALYSIS, ISGIE 2022, 2022, 13754 : 89 - 98