Personalized and motion-based human activity recognition with transfer learning and compressed deep learning models

被引:5
|
作者
Bursa, Sevda Ozge [1 ]
Incel, Ozlem Durmaz [2 ]
Alptekin, Gulfem Isiklar [1 ]
机构
[1] Galatasaray Univ, Dept Comp Engn, Ciragan Cad 36, TR-34349 Istanbul, Turkiye
[2] Bogazici Univ, Dept Comp Engn, TR-34342 Istanbul, Turkiye
关键词
Human activity recognition (HAR); Deep learning (DL); Transfer learning (TL); Model compression; Motion sensors;
D O I
10.1016/j.compeleceng.2023.108777
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Human activity recognition (HAR) enables the recognition of the activities of daily living using signals from motion sensors integrated into mobile and wearable devices. One of the challenges is the uniqueness of each individual with his/her different characteristics. A general model trained without user data may perform poorly on specific users. Another challenge is running deep learning (DL) models on mobile and wearable devices due to their limited resources. In this paper, to cope with these two challenges, we use transfer learning to build personalized models and model compression for running DL algorithms. We examine the impact of different DL architectures, the number of layers to be fine-tuned, the amount of user training data, and the transfer to new datasets on the performance of HAR. We compare the performance of the transferred models with general and user-specific models in terms of F1 score, training and inference time.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Transfer Learning from Audio Deep Learning Models for Micro-Doppler Activity Recognition
    Tran, Kimberly T.
    Griffin, Lewis D.
    Chetty, Kevin
    Vishwakarma, Shelly
    2020 IEEE INTERNATIONAL RADAR CONFERENCE (RADAR), 2020, : 584 - 589
  • [22] Systematic Evaluation of Personalized Deep Learning Models for Affect Recognition
    Han, Yunjo
    Zhang, Panyu
    Park, Minseo
    Lee, Uichin
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2024, 8 (04):
  • [23] Through-Wall Human Motion Recognition Based on Transfer Learning and Ensemble Learning
    Chen, Pengyun
    Guo, Shisheng
    Li, Huquan
    Wang, Xiang
    Cui, Guolong
    Jiang, Chaoshu
    Kong, Lingjiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [24] Personalized models for facial emotion recognition through transfer learning
    Martina Rescigno
    Matteo Spezialetti
    Silvia Rossi
    Multimedia Tools and Applications, 2020, 79 : 35811 - 35828
  • [25] Personalized models for facial emotion recognition through transfer learning
    Rescigno, Martina
    Spezialetti, Matteo
    Rossi, Silvia
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (47-48) : 35811 - 35828
  • [26] Empirical Study and Improvement on Deep Transfer Learning for Human Activity Recognition
    Ding, Renjie
    Li, Xue
    Nie, Lanshun
    Li, Jiazhen
    Si, Xiandong
    Chu, Dianhui
    Liu, Guozhong
    Zhan, Dechen
    SENSORS, 2019, 19 (01)
  • [27] Human Activity Recognition in Smart Home using Deep Learning Models
    Diallo, Abdoulaye
    Diallo, Cherif
    2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2021), 2021, : 1511 - 1515
  • [28] A Comparative Analysis of Hybrid Deep Learning Models for Human Activity Recognition
    Abbaspour, Saedeh
    Fotouhi, Faranak
    Sedaghatbaf, Ali
    Fotouhi, Hossein
    Vahabi, Maryam
    Linden, Maria
    SENSORS, 2020, 20 (19) : 1 - 14
  • [29] Personalized human activity recognition using deep learning and edge-cloud architecture
    Luay Alawneh
    Mahmoud Al-Ayyoub
    Ziad A. Al-Sharif
    Ahmed Shatnawi
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 12021 - 12033
  • [30] Sensor fusion of motion-based sign language interpretation with deep learning
    Lee, Boon Giin
    Chong, Teak-Wei
    Chung, Wan-Young
    Sensors (Switzerland), 2020, 20 (21): : 1 - 17