Measuring Saccade Latency Using Smartphone Cameras

被引:19
|
作者
Lai, Hsin-Yu [1 ]
Saavedra-Pena, Gladynel [1 ]
Sodini, Charles G. [2 ,3 ]
Sze, Vivienne [1 ,4 ]
Heldt, Thomas [2 ,4 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Dept Elect Engn & Comp Sci, Inst Med Engn & Sci, Cambridge, MA 02139 USA
[3] MIT, Microsyst Technol Lab, Cambridge, MA 02139 USA
[4] MIT, Res Lab Elect, Cambridge, MA 02139 USA
关键词
Diseases; Cameras; Task analysis; Visualization; Portable computers; Biomedical measurement; Face; Eye tracking; convolutional neural networks; health monitoring; saccade latency; mobile imaging; FRONTOTEMPORAL LOBAR DEGENERATION; MENTAL-STATE-EXAMINATION; TEST-RETEST RELIABILITY; EYE-MOVEMENTS; COGNITIVE IMPAIRMENT; OCULOMOTOR FUNCTION; PARKINSONS-DISEASE; RESPONSE-TIMES; DEMENTIA; VARIABILITY;
D O I
10.1109/JBHI.2019.2913846
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective: Accurate quantification of neurodegenerative disease progression is an ongoing challenge that complicates efforts to understand and treat these conditions. Clinical studies have shown that eye movement features may serve as objective biomarkers to support diagnosis and tracking of disease progression. Here, we demonstrate that saccade latency-an eye movement measure of reaction time-can be measured robustly outside of the clinical environment with a smartphone camera. Methods: To enable tracking of saccade latency in large cohorts of patients and control subjects, we combined a deep convolutional neural network for gaze estimation with a model-based approach for saccade onset determination that provides automated signal-quality quantification and artifact rejection. Results: Simultaneous recordings with a smartphone and a high-speed camera resulted in negligible differences in saccade latency distributions. Furthermore, we demonstrated that the constraint of chinrest support can be removed when recording healthy subjects. Repeat smartphone-based measurements of saccade latency in 11 self-reported healthy subjects resulted in an intraclass correlation coefficient of 0.76, showing our approach has good to excellent test-retest reliability. Additionally, we conducted more than 19 000 saccade latency measurements in 29 self-reported healthy subjects and observed significant intra- and inter-subject variability, which highlights the importance of individualized tracking. Lastly, we showed that with around 65 measurements we can estimate mean saccade latency to within less-than-10-ms precision, which takes within 4 min with our setup. Conclusion and Significance: By enabling repeat measurements of saccade latency and its distribution in individual subjects, our framework opens the possibility of quantifying patient state on a finer timescale in a broader population than previously possible.
引用
收藏
页码:885 / 897
页数:13
相关论文
共 50 条
  • [1] ENABLING SACCADE LATENCY MEASUREMENTS WITH CONSUMER-GRADE CAMERAS
    Lai, Hsin-Yu
    Saavedra-Pena, Gladynel
    Sodini, Charles
    Heldt, Thomas
    Sze, Vivienne
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3169 - 3173
  • [2] Using Rear Smartphone Cameras as Sensors for Measuring Heart Rate Variability
    Zhang, Genxuan
    Zhang, Sai
    Dai, Yiming
    Shi, Bo
    IEEE ACCESS, 2021, 9 (09): : 20460 - 20468
  • [3] Measuring Oxygen Saturation With Smartphone Cameras Using Convolutional Neural Networks
    Ding, Xinyi
    Nassehi, Damoun
    Larson, Eric C.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2019, 23 (06) : 2603 - 2610
  • [4] Performance and Uncertainty in Measuring Atmospheric Plume Opacity Using Compact and Smartphone Digital Still Cameras
    Yuen, Wangki
    Gu, Yichao
    Mao, Yalin
    Koloutsou-Vakakis, Sotiria
    Rood, Mark J.
    Son, Hyun-Keun
    Mattison, Kevin
    Franek, Bill
    Du, Ke
    AEROSOL AND AIR QUALITY RESEARCH, 2017, 17 (05) : 1281 - 1293
  • [5] Accuracy of corrective saccade in the dark depends on the latency of the primary saccade
    Tian, Jing
    Ying, Howard
    Zee, David
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2013, 54 (15)
  • [6] Bilateral interactions in saccade programming - A saccade-latency study
    Cavegn, D
    EXPERIMENTAL BRAIN RESEARCH, 1996, 109 (02) : 312 - 332
  • [7] Mobile Biosensing using the Sensing Capabilities of Smartphone Cameras
    Cunningham, Brian T.
    Long, Kenneth D.
    Yu, Hojoeng
    Chen, Weili
    Sun, Fu
    Ornob, Akid
    Ganguli, Anurup
    Lumetta, Stephen
    Bashir, Rashid
    2017 IEEE MTT-S INTERNATIONAL MICROWAVE WORKSHOP SERIES ON ADVANCED MATERIALS AND PROCESSES FOR RF AND THZ APPLICATIONS (IMWS-AMP), 2017,
  • [8] Non-invasive Heart Rate Measuring Smartphone Applications using On-board Cameras: A Short Survey
    Papon, Md Tarikul Islam
    Ahmad, Ishtiyaque
    Saquib, Nazmus
    Rahman, Ashikur
    2015 INTERNATIONAL CONFERENCE ON NETWORKING SYSTEMS AND SECURITY (NSYSS), 2015, : 199 - 204
  • [9] Seeing Red: PPG Biometrics Using Smartphone Cameras
    Lovisotto, Giulio
    Turner, Henry
    Eberz, Simon
    Martinovic, Ivan
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 3565 - 3574
  • [10] Using smartphone cameras to photograph microscopic dermatologic images
    Lee, K. C.
    Cossman, J. P.
    Muglia, J.
    SKIN RESEARCH AND TECHNOLOGY, 2014, 20 (02) : 254 - 255