A lightweight neural network framework using linear grouped convolution for human activity recognition on mobile devices

被引:18
|
作者
Liu, Tianyi [1 ]
Wang, Shuoyuan [1 ]
Liu, Yue [1 ]
Quan, Weiming [1 ]
Zhang, Lei [1 ]
机构
[1] Nanjing Normal Univ, Sch Elect & Automat Engn, Nanjing, Jiangsu, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2022年 / 78卷 / 05期
基金
中国国家自然科学基金;
关键词
Sensor; Convolutional neural networks; Activity recognition; Deep learning; Linear grouped convolution; LEARNING APPROACH;
D O I
10.1007/s11227-021-04140-5
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Human activity recognition (HAR) has played an indispensable role in ubiquitous computing scenario, from smart homes to game console designing, elderly care, and fitness tracking. It is very hard to manually extract most suitable activity features from raw sensor time series. Due to an obvious advantage, convolutional neural networks (CNNs) that can extract features automatically have been widely utilized for activity recognition. Despite exceptional performance, CNNs are computation-intensive and memory-demanding algorithms because of a large number of internal parameters. As a result, the research attention in HAR implementations over resource-limited embedded platforms has turned to computationally lightweight convolution architectures. In this paper, we offer a contribution in the direction. Simple linear transformations with low cost are combined with a convolution-based HAR classifier to decrease overall computational/memory overhead and, simultaneously, which establishes an efficient classification method with satisfactory performance. Our new method is evaluated against standard convolution-based and residual counterparts, over several popular HAR datasets for algorithm benchmarking. Experimental results verify that, the cheap linear operations can significantly reduce computational and memory cost, and meanwhile producing satisfactory recognition performance, which is able to ensure faster inference on mobile devices. Our new method could be a strong candidate for real HAR implementations on embedded platforms with limited computing resources.
引用
收藏
页码:6696 / 6716
页数:21
相关论文
共 50 条
  • [1] A lightweight neural network framework using linear grouped convolution for human activity recognition on mobile devices
    Tianyi Liu
    Shuoyuan Wang
    Yue Liu
    Weiming Quan
    Lei Zhang
    The Journal of Supercomputing, 2022, 78 : 6696 - 6716
  • [2] A Lightweight Framework for Human Activity Recognition on Wearable Devices
    Coelho, Yves Luduvico
    Souza dos Santos, Francisco de Assis
    Frizera-Neto, Anselmo
    Bastos-Filho, Teodiano Freire
    IEEE SENSORS JOURNAL, 2021, 21 (21) : 24471 - 24481
  • [3] Human Activity Recognition with Convolution Neural Network using TIAGo Robot
    Mocanu, Irina
    Axinte, Dana
    Cramariuc, Oana
    Cramariuc, Bogdan
    2018 41ST INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2018, : 315 - 318
  • [4] LIMUNet: A Lightweight Neural Network for Human Activity Recognition Using Smartwatches
    Lin, Liangliang
    Wu, Junjie
    An, Ran
    Ma, Song
    Zhao, Kun
    Ding, Han
    APPLIED SCIENCES-BASEL, 2024, 14 (22):
  • [5] A LIGHTWEIGHT CONVOLUTION NEURAL NETWORK FOR AUTOMATIC DISASTERS RECOGNITION
    Munsif, Muhammad
    Afridi, Hina
    Ullah, Mohib
    Khan, Sultan Daud
    Cheikh, Faouzi Alaya
    Sajjad, Muhammad
    2022 10TH EUROPEAN WORKSHOP ON VISUAL INFORMATION PROCESSING (EUVIP), 2022,
  • [6] FitCNN: A Cloud-Assisted Lightweight Convolutional Neural Network Framework for Mobile Devices
    Li, Shiming
    Liu, Duo
    Xiang, Chaoneng
    Liu, Jianfeng
    Ling, Yingjian
    Liao, Tianjun
    Liang, Liang
    2017 IEEE 23RD INTERNATIONAL CONFERENCE ON EMBEDDED AND REAL-TIME COMPUTING SYSTEMS AND APPLICATIONS (RTCSA), 2017,
  • [7] Multi-Branch Attention-Based Grouped Convolution Network for Human Activity Recognition Using Inertial Sensors
    Li, Yong
    Wang, Luping
    Liu, Fen
    ELECTRONICS, 2022, 11 (16)
  • [8] A Novel Multichannel Dilated Convolution Neural Network for Human Activity Recognition
    Lin, Yingjie
    Wu, Jianning
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020 (2020)
  • [9] Vision based Human Activity Recognition using Deep Neural Network Framework
    Janardhanan, Jitha
    Umamaheswari, S.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (06) : 165 - 171
  • [10] Vehicle recognition using convolution neural network
    Khan, Maleika Heenaye-Mamode
    Khan, Chonnoo Abubakar Siddick
    Oumeir, Rengony Mohammad
    INTERNATIONAL JOURNAL OF BIOMETRICS, 2023, 15 (3-4) : 344 - 358