Personalized and motion-based human activity recognition with transfer learning and compressed deep learning models

被引:5
|
作者
Bursa, Sevda Ozge [1 ]
Incel, Ozlem Durmaz [2 ]
Alptekin, Gulfem Isiklar [1 ]
机构
[1] Galatasaray Univ, Dept Comp Engn, Ciragan Cad 36, TR-34349 Istanbul, Turkiye
[2] Bogazici Univ, Dept Comp Engn, TR-34342 Istanbul, Turkiye
关键词
Human activity recognition (HAR); Deep learning (DL); Transfer learning (TL); Model compression; Motion sensors;
D O I
10.1016/j.compeleceng.2023.108777
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Human activity recognition (HAR) enables the recognition of the activities of daily living using signals from motion sensors integrated into mobile and wearable devices. One of the challenges is the uniqueness of each individual with his/her different characteristics. A general model trained without user data may perform poorly on specific users. Another challenge is running deep learning (DL) models on mobile and wearable devices due to their limited resources. In this paper, to cope with these two challenges, we use transfer learning to build personalized models and model compression for running DL algorithms. We examine the impact of different DL architectures, the number of layers to be fine-tuned, the amount of user training data, and the transfer to new datasets on the performance of HAR. We compare the performance of the transferred models with general and user-specific models in terms of F1 score, training and inference time.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Motion Recognition Based on Deep Learning Algorithm
    Wang, Xue
    Liu, Li
    Zhang, Yingxing
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (14)
  • [32] Personalized human activity recognition using deep learning and edge-cloud architecture
    Alawneh, Luay
    Al-Ayyoub, Mahmoud
    Al-Sharif, Ziad A.
    Shatnawi, Ahmed
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 14 (9) : 12021 - 12033
  • [33] An Efficient Human Activity Recognition Technique Based on Deep Learning
    Khelalef, A.
    Ababsa, F.
    Benoudjit, N.
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2019, 29 (04) : 702 - 715
  • [34] An Efficient Human Activity Recognition Technique Based on Deep Learning
    A. Khelalef
    F. Ababsa
    N. Benoudjit
    Pattern Recognition and Image Analysis, 2019, 29 : 702 - 715
  • [35] A Deep Learning Framework for Smartphone Based Human Activity Recognition
    Mallik, Manjarini
    Sarkar, Garga
    Chowdhury, Chandreyee
    MOBILE NETWORKS & APPLICATIONS, 2024, 29 (01): : 29 - 41
  • [36] Robust Human Activity Recognition based on Deep Metric Learning
    Abdu-Aguye, Mubarak G.
    Gomaa, Walid
    ICINCO: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 1, 2019, : 656 - 663
  • [37] Sensor Fusion of Motion-Based Sign Language Interpretation with Deep Learning
    Lee, Boon Giin
    Chong, Teak-Wei
    Chung, Wan-Young
    SENSORS, 2020, 20 (21) : 1 - 17
  • [38] Deep appearance and motion learning for egocentric activity recognition
    Wang, Xuanhan
    Gao, Lianli
    Song, Jingkuan
    Zhen, Xiantong
    Sebe, Nicu
    Shen, Heng Tao
    NEUROCOMPUTING, 2018, 275 : 438 - 447
  • [39] Deep Transfer Learning Using Class Augmentation for Sensor-Based Human Activity Recognition
    Kondo, Kazuma
    Hasegawa, Tatsuhito
    IEEE SENSORS LETTERS, 2022, 6 (10)
  • [40] Recognition of Defective Carrots Based on Deep Learning and Transfer Learning
    Xie, Weijun
    Wei, Shuo
    Zheng, Zhaohui
    Jiang, Yu
    Yang, Deyong
    FOOD AND BIOPROCESS TECHNOLOGY, 2021, 14 (07) : 1361 - 1374