Visualizing simultaneous eye-hand movements in a MATLAB dashboard

被引:0
|
作者
Hudson, T. E. [1 ,2 ,3 ]
Seiple, A. [1 ]
Sabet, A. Shafiee [1 ]
Beheshti, M. [1 ,4 ]
Rizzo, J. R. [1 ,2 ,3 ,4 ]
机构
[1] NYU Langone Hlth, Dept Rehabil Med, 244 E38th St, New York, NY 10016 USA
[2] NYU Langone Hlth, Dept Neurol, 222 E40th St, New York, NY 10016 USA
[3] NYU, Dept Biomed Engn, Tandon Sch Engn, 433 First Ave, New York, NY 10010 USA
[4] NYU, Dept Mech & Aerosp Engn, Tandon Sch Engn, 433 First Ave, New York, NY 10010 USA
基金
美国国家卫生研究院;
关键词
Sensory -motor coordination; Visualization techniques; Eye tracking; Limb tracking;
D O I
10.1016/j.mex.2024.102722
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Eye-hand coordination (EHC) is crucial to our daily activities, and its underlying mechanisms are being intensely studied. The analysis of simultaneous eye and hand movements can provide valuable insights into EHC, particularly for individuals struggling with dexterous control, such as might be caused by stroke or traumatic brain injuries. Despite advancements in motion-capture and eye tracking technologies, there is currently no automated method for visualizing concurrent eye- and hand-movement data. To address this need, we have developed a MATLAB-based dashboard designed for near instantaneous analysis and visualization of eye and hand-tracking data. This paper introduces the design of the dashboard and presents experimental results obtained from its application, leveraging simulated data inspired by our recent work in stroke. This testing suggests that our solution has the potential to significantly aid in understanding and investigating EHC by providing side-by-side and time-locked comparison of eye/hand movements along with their timing and spatio-temporal errors, offering novel opportunities for research and clinical applications. center dot Continuous eye movement data is collected throughout the experiment center dot Continuous hand movement data is collected throughout the experiment center dot Combine datasets and display time-locked eye-hand data in a single dashboard
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Eye movements and the eye-hand span in typewriting
    Bjtsch, RLC
    JOURNAL OF EDUCATIONAL PSYCHOLOGY, 1932, 23 : 104 - 121
  • [2] Eye movements and eye-hand coordination during typing
    Inhoff, AW
    Gordon, AM
    CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 1997, 6 (06) : 153 - 157
  • [3] Independent Allocation of Attention to Eye and Hand Targets in Coordinated Eye-Hand Movements
    Jonikaitis, Donatas
    Deubel, Heiner
    PSYCHOLOGICAL SCIENCE, 2011, 22 (03) : 339 - 347
  • [4] Exploiting eye-hand coordination to detect grasping movements
    Carrasco, Miguel
    Clady, Xavier
    IMAGE AND VISION COMPUTING, 2012, 30 (11) : 860 - 874
  • [5] Theory of visual attention (TVA) in action: Assessing premotor attention in simultaneous eye-hand movements
    Kreyenmeier, Philipp
    Deubel, Heiner
    Hanning, Nina M.
    CORTEX, 2020, 133 : 133 - 148
  • [6] Eye-hand coordination: Eye to hand or hand to eye?
    Carey, DP
    CURRENT BIOLOGY, 2000, 10 (11) : R416 - R419
  • [7] Eye-hand coordination all the way: from discrete to continuous hand movements
    Coudiere, Adrien
    Danion, Frederic R.
    JOURNAL OF NEUROPHYSIOLOGY, 2024, 131 (04) : 652 - 667
  • [8] Interaction between the premotor processes of eye and hand movements: Possible mechanism underlying eye-hand coordination
    Hiraoka, Koichi
    Kurata, Naoatsu
    Sakaguchi, Masato
    Nonaka, Kengo
    Matsumoto, Naoto
    SOMATOSENSORY AND MOTOR RESEARCH, 2014, 31 (01): : 49 - 55
  • [9] EYE-HAND COORDINATION - SPATIAL LOCALIZATION AFTER SACCADIC AND PURSUIT EYE-MOVEMENTS
    ABRAMS, RA
    OWENS, P
    ZEFFREN, M
    DROTMAN, M
    BULLETIN OF THE PSYCHONOMIC SOCIETY, 1990, 28 (06) : 524 - 524
  • [10] Eye-hand coupling is not the cause of manual return movements when searching
    Liesker, Hanneke
    Brenner, Eli
    Smeets, Jeroen B. J.
    EXPERIMENTAL BRAIN RESEARCH, 2010, 201 (02) : 221 - 227