Assessment of deep learning pose estimates for sports collision tracking

被引:0
|
作者
Blythman, Richard [1 ]
Saxena, Manan [2 ]
Tierney, Gregory J. [3 ]
Richter, Chris [4 ]
Smolic, Aljosa [1 ]
Simms, Ciaran [2 ]
机构
[1] Trinity Coll Dublin, Sch Comp Sci & Stat SCSS, V SENSE, Dublin, Ireland
[2] Trinity Coll Dublin, Sch Engn, Dublin, Ireland
[3] Univ Leeds, Sch Biomed Sci, Leeds, W Yorkshire, England
[4] Sports Surg Clin, Dublin, Ireland
基金
爱尔兰科学基金会;
关键词
3D pose estimation; deep learning; markerless motion capture; injury surveillance; rugby tackles; sports motion trackin; HIP-JOINT CENTER; CENTER LOCALIZATION; VIDEO ANALYSIS; RISK-FACTORS; RUGBY UNION; HEAD; PREVENTION; VALIDATION; EVENTS; INJURY;
D O I
10.1080/02640414.2022.2117474
中图分类号
G8 [体育];
学科分类号
04 ; 0403 ;
摘要
Injury assessment during sporting collisions requires estimation of the associated kinematics. While marker-based solutions are widely accepted as providing accurate and reliable measurements, setup times are lengthy and it is not always possible to outfit athletes with restrictive equipment in sporting situations. A new generation of markerless motion capture based on deep learning techniques holds promise for enabling measurement of movement in the wild. The aim of this work is to evaluate the performance of a popular deep learning model "out of the box" for human pose estimation, on a dataset of ten staged rugby tackle movements performed in a marker-based motion capture laboratory with a system of three high-speed video cameras. An analysis of the discrepancy between joint positions estimated by the marker-based and markerless systems shows that the deep learning approach performs acceptably well in most instances, although high errors exist during challenging intervals of heavy occlusion and self-occlusion. In total, 75.6% of joint position estimates are found to have a mean absolute error (MAE) of less than or equal to 25 mm, 17.8% with MAE between 25 and 50 mm and 6.7% with MAE greater than 50 mm. The mean per joint position error is 47 mm.
引用
收藏
页码:1885 / 1900
页数:16
相关论文
共 50 条
  • [1] SLEAP: A deep learning system for multi-animal pose tracking
    Talmo D. Pereira
    Nathaniel Tabris
    Arie Matsliah
    David M. Turner
    Junyu Li
    Shruthi Ravindranath
    Eleni S. Papadoyannis
    Edna Normand
    David S. Deutsch
    Z. Yan Wang
    Grace C. McKenzie-Smith
    Catalin C. Mitelut
    Marielisa Diez Castro
    John D’Uva
    Mikhail Kislin
    Dan H. Sanes
    Sarah D. Kocher
    Samuel S.-H. Wang
    Annegret L. Falkner
    Joshua W. Shaevitz
    Mala Murthy
    [J]. Nature Methods, 2022, 19 : 486 - 495
  • [2] Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview
    Fan, Zhaoxin
    Zhu, Yazhi
    He, Yulin
    Sun, Qi
    Liu, Hongyan
    He, Jun
    [J]. ACM COMPUTING SURVEYS, 2023, 55 (04)
  • [3] SLEAP: A deep learning system for multi-animal pose tracking
    Pereira, Talmo D.
    Tabris, Nathaniel
    Matsliah, Arie
    Turner, David M.
    Li, Junyu
    Ravindranath, Shruthi
    Papadoyannis, Eleni S.
    Normand, Edna
    Deutsch, David S.
    Wang, Z. Yan
    McKenzie-Smith, Grace C.
    Mitelut, Catalin C.
    Castro, Marielisa Diez
    D'Uva, John
    Kislin, Mikhail
    Sanes, Dan H.
    Kocher, Sarah D.
    Wang, Samuel S-H
    Falkner, Annegret L.
    Shaevitz, Joshua W.
    Murthy, Mala
    [J]. NATURE METHODS, 2022, 19 (04) : 486 - +
  • [4] Sports video key pose data incremental mining algorithm based on deep learning
    Zhang, Libo
    [J]. Journal of Computers (Taiwan), 2021, 32 (02) : 187 - 196
  • [5] A Study on Sports Player Tracking based on Video using Deep Learning
    Lee, JungSoo
    Moon, Sungwon
    Nam, Do-Won
    Lee, Jiwon
    Oh, Ah Reum
    Yoo, Wonyoung
    [J]. 11TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE: DATA, NETWORK, AND AI IN THE AGE OF UNTACT (ICTC 2020), 2020, : 1161 - 1163
  • [6] Pose estimation with deep learning
    Vogt, Nina
    [J]. NATURE METHODS, 2019, 16 (12) : 1205 - 1205
  • [7] Pose estimation with deep learning
    Nina Vogt
    [J]. Nature Methods, 2019, 16 : 1205 - 1205
  • [8] Publisher Correction: SLEAP: A deep learning system for multi-animal pose tracking
    Talmo D. Pereira
    Nathaniel Tabris
    Arie Matsliah
    David M. Turner
    Junyu Li
    Shruthi Ravindranath
    Eleni S. Papadoyannis
    Edna Normand
    David S. Deutsch
    Z. Yan Wang
    Grace C. McKenzie-Smith
    Catalin C. Mitelut
    Marielisa Diez Castro
    John D’Uva
    Mikhail Kislin
    Dan H. Sanes
    Sarah D. Kocher
    Samuel S.-H. Wang
    Annegret L. Falkner
    Joshua W. Shaevitz
    Mala Murthy
    [J]. Nature Methods, 2022, 19 : 628 - 628
  • [9] A deep learning framework for multi-object tracking in team sports videos
    Cao, Wei
    Wang, Xiaoyong
    Liu, Xianxiang
    Xu, Yishuai
    [J]. IET COMPUTER VISION, 2024, 18 (05) : 574 - 590
  • [10] Refining Joint Locations for Human Pose Tracking in Sports Videos
    Zecha, Dan
    Einfalt, Moritz
    Lienhart, Rainer
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 2524 - 2532