Efficient Deep Learning on Wearable Physiological Sensor Data for Pilot Flight Performance Analysis

被引:0
|
作者
Moore, Patrick W. [1 ]
Rao, Hrishikesh M. [2 ]
Beauchene, Christine [2 ]
Cowen, Emilie [2 ]
Yuditskaya, Sophia [2 ]
Heldt, Thomas [3 ]
Brattain, Laura J. [2 ]
机构
[1] MIT, Dept Air Force, Artificial Intelligence Accelerator, Cambridge, MA 02139 USA
[2] MIT, Lincoln Lab, Lexington, MA USA
[3] MIT, Cambridge, MA USA
关键词
deep learning; dimensionality reduction; physiological sensing; performance analysis; wearable sensor;
D O I
10.1109/BSN58485.2023.10331087
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the proliferation of wearable sensors for physiological and cognitive monitoring, a large amount of time series data needs to be processed and analyzed in a timely fashion. While deep learning has shown to be useful for the analysis, the majority of the deep learning methods are computing resource intensive. This paper demonstrates an efficient deep learning approach by adapting MINIROCKET to eye tracking and electrodermal activity data for flight performance assessment. The model was trained on 35 subjects using leave-one-subject-out cross validation and further evaluated on an independent data set of 8 subjects. We performed dimensionality reduction on each time series observation, reducing the size by 99.7% while still achieving averaged Area Under the Curve of 0.912 and average equal error rate of 0.181, thus enabling fast and accurate inference on edge devices. The approach presented here can be implemented in real-world cockpits for near instantaneous performance monitoring and could also be extended beyond this domain to other resource constrained time series applications.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Scalable Deep Learning for Pilot Performance Analysis Using Multimodal Physiological Time Series
    Lee, Noah
    Moore, Patrick W.
    Brattain, Laura J.
    [J]. 2023 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE, HPEC, 2023,
  • [2] Deep learning analysis of mobile physiological, environmental and location sensor data for emotion detection
    Kanjo, Eiman
    Younis, Eman M. G.
    Ang, Chee Siang
    [J]. INFORMATION FUSION, 2019, 49 : 46 - 56
  • [3] Data fusion for wearable physiological sensor platforms
    Egan, BF
    Mizutani, T
    Thurlow, A
    [J]. 2005 7th International Conference on Information Fusion (FUSION), Vols 1 and 2, 2005, : 1412 - 1419
  • [4] Deep Knowledge Distillation Learning for Efficient Wearable Data Mining on the Edge
    Wong, Junhua
    Zhang, Qingxue
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [5] Pilot Maneuvering Performance Analysis and Evaluation with Deep Learning
    Zhang, Shiwen
    Huo, Zhimei
    Sun, Yanjin
    Li, Fujuan
    Jia, Bo
    [J]. INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2023, 2023
  • [6] Fall Detection using Deep Learning Algorithms and Analysis of Wearable Sensor Data by Presenting a New Sampling Method
    Hatkeposhti, R. Keramati
    Tabari, M. Yadollahzadeh
    GolsorkhtabariAmiri, M.
    [J]. INTERNATIONAL JOURNAL OF ENGINEERING, 2022, 35 (10): : 1941 - 1958
  • [7] A Survey on Human Activity Recognition Using Deep Learning Techniques and Wearable Sensor Data
    Dua, Nidhi
    Singh, Shiva Nand
    Challa, Sravan Kumar
    Semwal, Vijay Bhaskar
    Kumar, M. L. S. Sai
    [J]. MACHINE LEARNING, IMAGE PROCESSING, NETWORK SECURITY AND DATA SCIENCES, MIND 2022, PT I, 2022, 1762 : 52 - 71
  • [8] A Deep Learning Approach to on-Node Sensor Data Analytics for Mobile or Wearable Devices
    Ravi, Daniele
    Wong, Charence
    Lo, Benny
    Yang, Guang-Zhong
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2017, 21 (01) : 56 - 64
  • [9] Wearable sensor data based human activity recognition using deep learning: A new approach
    Phuong Hanh Tran
    Quoc Thong Nguyen
    Kim Phuc Tran
    Heuchenne, Cedric
    [J]. DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 581 - 588
  • [10] Performance Analysis of LEACH with Deep Learning in Wireless Sensor Networks
    Prajapati, Hardik K.
    Joshi, Rutvij
    [J]. INTERNATIONAL JOURNAL OF ELECTRONICS AND TELECOMMUNICATIONS, 2022, 68 (04) : 799 - 805