A Deep Neural Network-based method for estimation of 3D lifting motions

被引:28
|
作者
Mehrizi, Rahil [1 ]
Peng, Xi [2 ]
Xu, Xu [5 ]
Zhang, Shaoting [6 ]
Li, Kang [2 ,3 ,4 ]
机构
[1] Rutgers State Univ, Dept Ind & Syst Engn, Piscataway, NJ USA
[2] Rutgers State Univ, Dept Comp Sci, Piscataway, NJ USA
[3] Rutgers State Univ, Dept Biomed Engn, Piscataway, NJ USA
[4] Rutgers New Jersey Med Sch, Dept Orthopaed, Newark, NJ 07103 USA
[5] North Carolina State Univ, Edward P Fitts Dept Ind & Syst Engn, Raleigh, NC 27695 USA
[6] Univ N Carolina, Dept Comp Sci, Charlotte, NC USA
关键词
3D pose estimation; Machine learning; Deep Neural Network; Lifting; Biomechanics; MARKERLESS; KINEMATICS; DISORDERS; CAPTURE;
D O I
10.1016/j.jbiomech.2018.12.022
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The aim of this study is developing and validating a Deep Neural Network (DNN) based method for 3D pose estimation during lifting. The proposed DNN based method addresses problems associated with marker-based motion capture systems like excessive preparation time, movement obstruction, and controlled environment requirement. Twelve healthy adults participated in a protocol and performed nine lifting tasks with different vertical heights and asymmetry angles. They lifted a crate and placed it on a shelf while being filmed by two camcorders and a synchronized motion capture system, which directly measured their body movement. A DNN with two-stage cascaded structure was designed to estimate subjects' 3D body pose from images captured by camcorders. Our DNN augmented Hourglass network for monocular 2D pose estimation with a novel 3D pose generator subnetwork, which synthesized information from all available views to predict accurate 3D pose. We validated the results against the marker based motion capture system as a reference and examined the method performance under different lifting conditions. The average Euclidean distance between the estimated 3D pose and reference (3D pose error) on the whole dataset was 14.72 +/- 2.96 mm. Repeated measures ANOVAs showed lifting conditions can affect the method performance e.g. 60 degrees asymmetry angle and shoulder height lifting showed higher 3D pose error compare to other lifting conditions. The results demonstrated the capability of the proposed method for 3D pose estimation with high accuracy and without limitations of marker-based motion capture systems. The proposed method may be utilized as an on-site biomechanical analysis tool. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 93
页数:7
相关论文
共 50 条
  • [1] A Convolutional Neural Network-Based Method for 3D Object Detection
    Li Y.
    Shi L.
    Wan W.
    Zhao Q.
    [J]. Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2018, 52 (01): : 7 - 12
  • [2] Artificial neural network-based method for stereoscopic 3D reconstruction
    Do Y.
    [J]. Journal of Institute of Control, Robotics and Systems, 2020, 26 (03) : 162 - 167
  • [3] A novel neural network-based 3D animation model classification method
    Shi, Ximan
    [J]. INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2023, 71 (03) : 222 - 228
  • [4] Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging
    Scheinker, Alexander
    Pokharel, Reeju
    [J]. JOURNAL OF APPLIED PHYSICS, 2020, 128 (18)
  • [5] A neural network-based point registration method for 3D rigid face image
    Junfen Chen
    Iman Yi Liao
    Bahari Belaton
    Munir Zaman
    [J]. World Wide Web, 2015, 18 : 197 - 214
  • [6] A neural network-based point registration method for 3D rigid face image
    Chen, Junfen
    Liao, Iman Yi
    Belaton, Bahari
    Zaman, Munir
    [J]. WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2015, 18 (02): : 197 - 214
  • [7] Deep neural network-based detection and segmentation of intracranial aneurysms on 3D rotational DSA
    Liu, Xinke
    Feng, Junqiang
    Wu, Zhenzhou
    Neo, Zhonghao
    Zhu, Chengcheng
    Zhang, Peifang
    Wang, Yan
    Jiang, Yuhua
    Mitsouras, Dimitrios
    Li, Youxiang
    [J]. INTERVENTIONAL NEURORADIOLOGY, 2021, 27 (05) : 648 - 657
  • [8] Deep Neural Network-Based Novel Mathematical Model for 3D Brain Tumor Segmentation
    Ladkat, Ajay S.
    Bangare, Sunil L.
    Jagota, Vishal
    Sanober, Sumaya
    Beram, Shehab Mohamed
    Rane, Kantilal
    Singh, Bhupesh Kumar
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [9] Efficient representation and feature extraction for neural network-based 3D object pose estimation
    Kouskouridas, Rigas
    Gasteratos, Antonios
    Emmanouilidis, Christos
    [J]. NEUROCOMPUTING, 2013, 120 : 90 - 100
  • [10] 3D Face Recognition Method Based on Deep Convolutional Neural Network
    Feng, Jianying
    Guo, Qian
    Guan, Yudong
    Wu, Mengdie
    Zhang, Xingrui
    Ti, Chunli
    [J]. SMART INNOVATIONS IN COMMUNICATION AND COMPUTATIONAL SCIENCES, VOL 2, 2019, 670 : 123 - 130