Detection of visual pursuits using 1D convolutional neural networks

被引:0
|
作者
Carneiro, Alex Torquato S. [1 ]
Coutinho, Flavio Luiz [2 ]
Morimoto, Carlos H. [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
[2] Univ Sao Paulo, Sch Arts Sci & Humanities, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Eye tracking; Eye gaze pursuit; Convolutional neural networks; Eye movements classification;
D O I
10.1016/j.patrec.2024.01.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The visual pursuit of moving targets is a natural behaviour that has been exploited in, for example, medical diagnosis, law enforcement, and human computer interaction. Most proposed algorithms to detect this behaviour are based on some kind of motion similarity metric that assumes small or no distortion between the trajectory described by the target being pursued and the sensor measurements. We propose a novel algorithm based on 1D Convolutional Neural Networks (1D-CNNs), and investigate the performance of the 1D-CNN against 4 state-ofthe-art similarity based algorithms (SAs), using a novel dataset containing data from 10 participants. Their performances are evaluated using two trajectory shapes (circle and square), two target speeds (120/s and 240/ s), and three window sizes (0.5, 1.0 and 1.5 s). All algorithms have been trained or optimized to maximize the Matthew's Correlation Coefficient (MCC). Our results show that the 1D-CNN outperforms the SAs in all cases, requiring smaller window sizes to robustly detect the pursuits.
引用
收藏
页码:45 / 51
页数:7
相关论文
共 50 条
  • [41] Recognizing Activities of Daily Living using 1D Convolutional Neural Networks for Efficient Smart Homes
    Alghamdi, Sumaya
    Fadel, Etimad
    Alowidi, Nahid
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (01) : 313 - 323
  • [42] Predicting kinetic triplets using a 1d convolutional neural network
    Kuang, Dongyang
    Xu, Bang
    THERMOCHIMICA ACTA, 2018, 669 : 8 - 15
  • [43] Stamping Monitoring by Using an Adaptive 1D Convolutional Neural Network
    Huang, Chih-Yung
    Dzulfikri, Zaky
    SENSORS, 2021, 21 (01) : 1 - 21
  • [44] Convolutional Networks with Oriented 1D Kernels
    Kirchmeyer, Alexandre
    Deng, Jia
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6199 - 6209
  • [45] Wearable Devices Acquired ECG Signals Detection Method Using 1D Convolutional Neural Network
    Hui, Yi
    Yin, Zhendong
    Wu, Mingyang
    Li, Dasen
    2021 15TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION AND COMMUNICATION TECHNOLOGY (ISMICT), 2021, : 81 - 85
  • [46] Visual Features for Improving Endoscopic Bleeding Detection Using Convolutional Neural Networks
    Brzeski, Adam
    Dziubich, Tomasz
    Krawczyk, Henryk
    SENSORS, 2023, 23 (24)
  • [47] Bolt-Loosening Detection Using 1D and 2D Input Data Based on Two-Stream Convolutional Neural Networks
    Hou, Xiaoli
    Guo, Weichao
    Ren, Shengjie
    Li, Yan
    Si, Yue
    Su, Lizheng
    MATERIALS, 2022, 15 (19)
  • [48] Violence Detection using 3D Convolutional Neural Networks
    Su, Jiayi
    Her, Paris
    Clemens, Erik
    Yaz, Edwin
    Schneider, Susan
    Medeiros, Henry
    2022 18TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2022), 2022,
  • [49] Hands-On Fundamentals of 1D Convolutional Neural Networks—A Tutorial for Beginner Users
    Cacciari, Ilaria
    Ranfagni, Anedio
    Applied Sciences (Switzerland), 2024, 14 (18):
  • [50] 1D convolutional neural networks for chart pattern classification in financial time series
    Liying Liu
    Yain-Whar Si
    The Journal of Supercomputing, 2022, 78 : 14191 - 14214