A Markerless Pose Estimator Applicable to Limbless Animals

被引:3
|
作者
Garg, Vranda [1 ]
Andre, Selina [1 ]
Giraldo, Diego [1 ]
Heyer, Luisa [1 ]
Goepfert, Martin C. [1 ]
Dosch, Roland [2 ]
Geurten, Bart R. H. [1 ]
机构
[1] Georg August Univ Gottingen, Dept Cellular Neurosci, Gottingen, Germany
[2] Georg August Univ Gottingen, Univ Med Ctr Gottingen, Inst Human genet, Gottingen, Germany
来源
关键词
animal tracker; zebrafish; Drosophila larva; gender dimorphism; Hough transform; intermittant locomotion; saccades; undulatory swimming; SACCADIC MOVEMENT STRATEGY; DROSOPHILA; TRACKING; BEHAVIOR; PLATFORM; MANIPULATION; LOCOMOTION; NANCHUNG; HEARING; MOTION;
D O I
10.3389/fnbeh.2022.819146
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The analysis of kinematics, locomotion, and spatial tasks relies on the accurate detection of animal positions and pose. Pose and position can be assessed with video analysis programs, the "trackers. " Most available trackers represent animals as single points in space (no pose information available) or use markers to build a skeletal representation of pose. Markers are either physical objects attached to the body (white balls, stickers, or paint) or they are defined in silico using recognizable body structures (e.g., joints, limbs, color patterns). Physical markers often cannot be used if the animals are small, lack prominent body structures on which the markers can be placed, or live in environments such as aquatic ones that might detach the marker. Here, we introduce a marker-free pose-estimator (LACE Limbless Animal traCkEr) that builds the pose of the animal de novo from its contour. LACE detects the contour of the animal and derives the body mid-line, building a pseudo-skeleton by defining vertices and edges. By applying LACE to analyse the pose of larval Drosophila melanogaster and adult zebrafish, we illustrate that LACE allows to quantify, for example, genetic alterations of peristaltic movements and gender-specific locomotion patterns that are associated with different body shapes. As illustrated by these examples, LACE provides a versatile method for assessing position, pose and movement patterns, even in animals without limbs.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Learning Markerless Human Pose Estimation from Multiple Viewpoint Video
    Trumble, Matthew
    Gilbert, Andrew
    Hilton, Adrian
    Collomosse, John
    Computer Vision - ECCV 2016 Workshops, Pt III, 2016, 9915 : 871 - 878
  • [22] Latent Pose Estimator for Continuous Action Recognition
    Ning, Huazhong
    Xu, Wei
    Gong, Yihong
    Huang, Thomas
    COMPUTER VISION - ECCV 2008, PT II, PROCEEDINGS, 2008, 5303 : 419 - +
  • [23] MarLe: Markerless estimation of head pose for navigated transcranial magnetic stimulation
    Matsuda, Renan H.
    Souza, Victor H.
    Kirsten, Petrus N.
    Ilmoniemi, Risto J.
    Baffa, Oswaldo
    PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2023, 46 (02) : 887 - 896
  • [24] Mutual Information of Image Intensity and Gradient Flux for Markerless Pose Estimation
    Campbell, Jordan
    Mills, Steven
    Paulin, Mike
    2015 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2015,
  • [25] Real-time dance evaluation by markerless human pose estimation
    Kim, Yeonho
    Kim, Daijin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (23) : 31199 - 31220
  • [26] TORSO POSE ESTIMATOR FOR A ROBOT IMITATION FRAMEWORK
    Cruz, A.
    Bandera, J. P.
    Sandoval, F.
    MOBILE ROBOTICS-SOLUTIONS AND CHALLENGES, 2010, : 901 - 908
  • [27] 3D Pose Estimation of Markerless Fish on Deep Learning
    Wang, Yuanchang
    Cao, Jianrong
    Wang, Ming
    Zhao, Qianchuan
    Gao, He
    NEURAL COMPUTING FOR ADVANCED APPLICATIONS, NCAA 2024, PT I, 2025, 2181 : 261 - 274
  • [28] Improving Knee Osteoarthritis Classification with Markerless Pose Estimation and STGCN Model
    Khessiba, Souhir
    Blaiech, Ahmed Ghazi
    Ben Abdallah, Asma
    Grassa, Rim
    Manzanera, Antoine
    Bedoui, Mohamed Hedi
    2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
  • [29] Real-time dance evaluation by markerless human pose estimation
    Yeonho Kim
    Daijin Kim
    Multimedia Tools and Applications, 2018, 77 : 31199 - 31220
  • [30] An efficient system for markerless gene replacement applicable in a wide variety of enterobacterial species
    White, A. P.
    Allen-Vercoe, E.
    Jones, B. W.
    DeVinney, R.
    Kay, W. W.
    Surette, M. G.
    CANADIAN JOURNAL OF MICROBIOLOGY, 2007, 53 (01) : 56 - 62