3D motion capture system for assessing patient motion during Fugl-Meyer stroke rehabilitation testing

被引:15
|
作者
Eichler, Nadav [1 ,2 ]
Hel-Or, Hagit [1 ]
Shimshoni, Ilan [2 ]
Itah, Dorit [3 ]
Gross, Bella [4 ,5 ]
Raz, Shmuel [2 ]
机构
[1] Univ Haifa, Dept Comp Sci, Haifa, Israel
[2] Univ Haifa, Dept Informat Syst, Haifa, Israel
[3] Galilee Med Ctr, Occupat Therapy Unit, Nahariyya, Israel
[4] Galilee Med Ctr, Dept Neurol, Nahariyya, Israel
[5] Bar Ilan Univ, Azrieli Sch Med, Ramat Gan, Israel
关键词
calibration; learning (artificial intelligence); cameras; pose estimation; patient rehabilitation; medical image processing; biomedical optical imaging; feature extraction; stroke patients; machine learning-based evaluations; Fugl-Meyer guidelines; noninvasive motion capture system; 3D motion capture system; patient motion; Fugl-Meyer stroke rehabilitation testing; human body; equipment-based calibration; Fugl-Meyer stroke rehabilitation protocol; Helsinki-approved research; spatiotemporal feature extraction; marker-less multicamera setup; multi-sensor capture system; pose estimation method; data merging; RELATE; 2; SETS; MICROSOFT KINECT; DEPTH; VALIDITY; ROTATION; GAIT;
D O I
10.1049/iet-cvi.2018.5274
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The authors introduce a novel marker-less multi-camera setup that allows easy synchronisation between 3D cameras as well as a novel pose estimation method that is calculated on the fly based on the human body being tracked, and thus requires no calibration session nor special calibration equipment. They show high accuracy in both calibration and data merging and is on par with equipment-based calibration. They deduce several insights and practical guidelines for the camera setup and for the preferred data merging methods. Finally, they present a test case that computerises the Fugl-Meyer stroke rehabilitation protocol using the authors' multi-sensor capture system. They conducted a Helsinki-approved research in a hospital in which they collected data on stroke patients and healthy subjects using their multi-camera system. Spatio-temporal features were extracted from the acquired data and machine learning-based evaluations were applied. Results showed that patients and healthy subjects can be correctly classified at a rate of above 90%. Furthermore, they show that the most significant features in the classification are strongly correlated with the Fugl-Meyer guidelines. This demonstrates the feasibility of a low-cost, flexible and non-invasive motion capture system that can potentially be operated in a home setting.
引用
收藏
页码:963 / 975
页数:13
相关论文
共 50 条
  • [1] Development of a Computerized Adaptive Testing System of the Fugl-Meyer Motor Scale in Stroke Patients
    Hou, Wen-Hsuan
    Shih, Ching-Lin
    Chou, Yeh-Tai
    Sheu, Ching-Fan
    Lin, Jau-Hong
    Wu, Hung-Chia
    Hsueh, I-Ping
    Hsieh, Ching-Lin
    [J]. ARCHIVES OF PHYSICAL MEDICINE AND REHABILITATION, 2012, 93 (06): : 1014 - 1020
  • [2] New system for 3D motion capture
    Mahoney, DP
    [J]. COMPUTER GRAPHICS WORLD, 1996, 19 (01) : 19 - 20
  • [3] Motion capture for 3D databases -: Overview of methods for motion capture in 3D databases
    Lupinek, Dalibor
    Drahansky, Martin
    [J]. SIGMAP 2008: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATIONS, 2008, : 99 - 104
  • [4] Markerless 3D Facial Motion Capture System
    Hwang, Youngkyoo
    Kim, Jung-Bae
    Feng, Xuetao
    Bang, Won-Chul
    Rhee, Taehyun
    Kim, James D. K.
    Kim, ChangYeong
    [J]. ENGINEERING REALITY OF VIRTUAL REALITY 2012, 2012, 8289
  • [5] Reliability of assessing shoulder kinematics using 3D motion capture
    Friesenbichler, Bernd
    Baumann, Rilena
    Grobet, Cecile
    Wirth, Barbara
    Audige, Laurent
    Maffiuletti, Nicola
    [J]. SWISS MEDICAL WEEKLY, 2018, 148 : 41S - 42S
  • [6] A Technical Demonstration on Streamlining 3D Motion ProductionWorkflows with a Markerless Motion Capture System
    Guo, Mengyao
    Nie, Yu
    Gao, Ze
    [J]. PROCEEDINGS OF THE 16TH CONFERENCE ON CREATIVITY AND COGNITION, C&C 2024, 2024, : 566 - 570
  • [7] The Design and Calibration of a 3D Motion Capture System for Arthropods
    Hoermann, Tobias J.
    Mills, Steven
    Paulin, Mike
    Reussenzehn, Stefan
    [J]. PROCEEDINGS OF 2013 28TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ 2013), 2013, : 265 - 269
  • [8] 3D Motion Parameters Fusion under a Multi-Vision Motion Capture System
    Gu, Erying
    Zheng, Jiangbin
    Zhang, Huanhuan
    [J]. PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 1908 - 1911
  • [9] Analysis of 3D human motion in a computer vision-based motion capture system
    Kim, SE
    Park, CJ
    Lee, RH
    Lee, IH
    [J]. KORUS 2003: 7TH KOREA-RUSSIA INTERNATIONAL SYMPOSIUM ON SCIENCE AND TECHNOLOGY, VOL 2, PROCEEDINGS: ELECTRICAL ENGINEERING AND INFORMATION TECHNOLOGY, 2003, : 329 - 334
  • [10] CUDA ACCELERATION OF 3D DYNAMIC SCENE RECONSTRUCTION AND 3D MOTION ESTIMATION FOR MOTION CAPTURE
    Zhang, Zheng
    Seah, Hock Soon
    [J]. PROCEEDINGS OF THE 2012 IEEE 18TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2012), 2012, : 284 - 291