Detection of visual pursuits using 1D convolutional neural networks

被引:0
|
作者
Carneiro, Alex Torquato S. [1 ]
Coutinho, Flavio Luiz [2 ]
Morimoto, Carlos H. [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
[2] Univ Sao Paulo, Sch Arts Sci & Humanities, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Eye tracking; Eye gaze pursuit; Convolutional neural networks; Eye movements classification;
D O I
10.1016/j.patrec.2024.01.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The visual pursuit of moving targets is a natural behaviour that has been exploited in, for example, medical diagnosis, law enforcement, and human computer interaction. Most proposed algorithms to detect this behaviour are based on some kind of motion similarity metric that assumes small or no distortion between the trajectory described by the target being pursued and the sensor measurements. We propose a novel algorithm based on 1D Convolutional Neural Networks (1D-CNNs), and investigate the performance of the 1D-CNN against 4 state-ofthe-art similarity based algorithms (SAs), using a novel dataset containing data from 10 participants. Their performances are evaluated using two trajectory shapes (circle and square), two target speeds (120/s and 240/ s), and three window sizes (0.5, 1.0 and 1.5 s). All algorithms have been trained or optimized to maximize the Matthew's Correlation Coefficient (MCC). Our results show that the 1D-CNN outperforms the SAs in all cases, requiring smaller window sizes to robustly detect the pursuits.
引用
收藏
页码:45 / 51
页数:7
相关论文
共 50 条
  • [31] A comparative Analysis of 1D Convolutional Neural Networks for Bearing Fault Diagnosis
    Bapir, Aydil
    Aydin, Ilhan
    2022 INTERNATIONAL CONFERENCE ON DECISION AID SCIENCES AND APPLICATIONS (DASA), 2022, : 1406 - 1411
  • [32] Joint Sample Expansion and 1D Convolutional Neural Networks for Tumor Classification
    Liu, Jian
    Cheng, Yuhu
    Wang, Xuesong
    Kong, Yi
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, ICIC 2017, PT II, 2017, 10362 : 135 - 141
  • [33] Footnote-based Document Image Classification using 1D Convolutional Neural Networks and Histograms
    Mhiri, Mohamed
    Abuelwafa, Sherif
    Desrosiers, Christian
    Cheriet, Mohamed
    PROCEEDINGS OF THE 2017 SEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA 2017), 2017,
  • [34] Lipschitz-bounded 1D convolutional neural networks using the Cayley transform and the controllability Gramian
    Pauli, Patricia
    Wang, Ruigang
    Manchester, Ian R.
    Allgower, Frank
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 5345 - 5350
  • [35] MULTIFREQUENCY POLSAR IMAGE CLASSIFICATION USING DUAL-BAND 1D CONVOLUTIONAL NEURAL NETWORKS
    Ahishali, Mete
    Kiranyaz, Serkan
    Ince, Turker
    Gabbouj, Moncef
    2020 MEDITERRANEAN AND MIDDLE-EAST GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (M2GARSS), 2020, : 73 - 76
  • [36] Short-Term Load Forecasting for Commercial Buildings Using 1D Convolutional Neural Networks
    Kaligambe, Abraham
    Fujita, Goro
    2020 IEEE PES & IAS POWERAFRICA CONFERENCE, 2020,
  • [37] Non-Invasive Prediction of Choledocholithiasis Using 1D Convolutional Neural Networks and Clinical Data
    Mena-Camilo, Enrique
    Salazar-Colores, Sebastian
    Aceves-Fernandez, Marco Antonio
    Lozada-Hernandez, Edgard Efren
    Ramos-Arreguin, Juan Manuel
    DIAGNOSTICS, 2024, 14 (12)
  • [38] Estimating State of Charge for xEV Batteries Using 1D Convolutional Neural Networks and Transfer Learning
    Bhattacharjee, Arnab
    Verma, Ashu
    Mishra, Sukumar
    Saha, Tapan K.
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (04) : 3123 - 3135
  • [39] Multimodal Emotion Recognition using Cross-Modal Attention and 1D Convolutional Neural Networks
    Krishna, D. N.
    Patil, Ankita
    INTERSPEECH 2020, 2020, : 4243 - 4247
  • [40] Finger ECG based Two-phase Authentication Using 1D Convolutional Neural Networks
    Chen, Ying
    Chen, Wenxi
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 336 - 339