Multi-sensor information fusion based on machine learning for real applications in human activity recognition: State-of-the-art and research challenges

被引:301
|
作者
Qiu, Sen [1 ,2 ]
Zhao, Hongkai [1 ,2 ]
Jiang, Nan [3 ]
Wang, Zhelong [1 ,2 ]
Liu, Long [1 ,2 ]
An, Yi [1 ,2 ]
Zhao, Hongyu [1 ,2 ]
Miao, Xin [1 ,2 ]
Liu, Ruichen [1 ,2 ]
Fortino, Giancarlo [4 ]
机构
[1] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equip, Minist Educ, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Sch Control Sci & Engn, Dalian 116024, Peoples R China
[3] East China Jiaotong Univ, Coll Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[4] Univ Calabria, Dept Informat Modeling Elect & Syst Engn, I-87036 Arcavacata Di Rende, Italy
基金
中国国家自然科学基金;
关键词
Wearable device; Information fusion; Human activity recognition; Machine learning; Deep learning; Transfer learning; BODY SENSOR NETWORK; NEURAL-NETWORK; TRIAXIAL ACCELEROMETER; INERTIAL SENSORS; SMARTPHONE SENSORS; NAVIGATION METHOD; MAGNETIC SENSORS; POSE ESTIMATION; FALL DETECTION; SYSTEM;
D O I
10.1016/j.inffus.2021.11.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper firstly introduces common wearable sensors, smart wearable devices and the key application areas. Since multi-sensor is defined by the presence of more than one model or channel, e.g. visual, audio, environmental and physiological signals. Hence, the fusion methods of multi-modality and multi-location sensors are proposed. Despite it has been contributed several works reviewing the stateoftheart on information fusion or deep learning, all of them only tackled one aspect of the sensor fusion applications, which leads to a lack of comprehensive understanding about it. Therefore, we propose using a more holistic approach in order to provide a more suitable starting point from which to develop a full understanding of the fusion methods of wearable sensors. Specifically, this review attempts to provide a more comprehensive survey of the most important aspects of multi-sensor applications for human activity recognition, including those recently added to the field for unsupervised learning and transfer learning. Finally, the open research issues that need further research and improvement are identified and discussed.
引用
收藏
页码:241 / 265
页数:25
相关论文
共 50 条
  • [1] Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges
    Gravina, Raffaele
    Alinia, Parastoo
    Ghasemzadeh, Hassan
    Fortino, Giancarlo
    [J]. INFORMATION FUSION, 2017, 35 : 68 - 80
  • [2] Multi-Sensor Information Fusion and Machine Learning for High Accuracy Rate of Mechanical Pedometer in Human Activity Recognition
    Adjeisah, Michael
    Liu, Guohua
    Nyabuga, Douglas Omwenga
    Nortey, Richard Nuetey
    [J]. 2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1064 - 1070
  • [3] Human Grasp Feature Learning and Object Recognition Based on Multi-sensor Information Fusion
    Zhang, Yangyang
    Huang, Ying
    Liu, Yue
    Liu, Caixia
    Liu, Ping
    Zhang, Yugang
    [J]. Jiqiren/Robot, 2020, 42 (03): : 267 - 277
  • [4] Multi-sensor integration management in the earth observation sensor web: State-of-the-art and research challenges
    Zhang, Yunbo
    Li, Jie
    Duan, Mu
    Chen, Wenjie
    del Rio, Joaquin
    Zhang, Xiang
    Wang, Ke
    Liang, Steve H. L.
    Chen, Zeqiang
    Chen, Nengcheng
    Hu, Chuli
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 125
  • [5] Effective recognition of human lower limb jump locomotion phases based on multi-sensor information fusion and machine learning
    Lu, Yanzheng
    Wang, Hong
    Hu, Fo
    Zhou, Bin
    Xi, Hailong
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2021, 59 (04) : 883 - 899
  • [6] Effective recognition of human lower limb jump locomotion phases based on multi-sensor information fusion and machine learning
    Yanzheng Lu
    Hong Wang
    Fo Hu
    Bin Zhou
    Hailong Xi
    [J]. Medical & Biological Engineering & Computing, 2021, 59 : 883 - 899
  • [7] Wearable multi-sensor data fusion approach for human activity recognition using machine learning algorithms
    Vidya, B.
    Sasikumar, P.
    [J]. SENSORS AND ACTUATORS A-PHYSICAL, 2022, 341
  • [8] Multi-sensor Intelligent Information Fusion Based on Fuzzy Integral with Applications in Target Recognition
    Xing, Qing-hua
    Xia, Lu
    Liu, Fu-xian
    Shang, Chang-an
    [J]. EMERGING RESEARCH IN ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, 2012, 315 : 463 - 470
  • [9] Multi-sensor data fusion for complex human activity recognition
    Song, Xinrui
    Zhang, Xianqi
    Zhang, Zhan
    Chen, Xinhao
    Liu, Hongwei
    [J]. Qinghua Daxue Xuebao/Journal of Tsinghua University, 2020, 60 (10): : 814 - 821
  • [10] Research on object tracking and recognition based on multi-sensor fusion
    Chen Ying
    Sun Jian-fen
    Lei Liang
    [J]. Proceedings of the 2007 Chinese Control and Decision Conference, 2007, : 245 - 248