A Markerless Pose Estimator Applicable to Limbless Animals

被引:3
|
作者
Garg, Vranda [1 ]
Andre, Selina [1 ]
Giraldo, Diego [1 ]
Heyer, Luisa [1 ]
Goepfert, Martin C. [1 ]
Dosch, Roland [2 ]
Geurten, Bart R. H. [1 ]
机构
[1] Georg August Univ Gottingen, Dept Cellular Neurosci, Gottingen, Germany
[2] Georg August Univ Gottingen, Univ Med Ctr Gottingen, Inst Human genet, Gottingen, Germany
来源
关键词
animal tracker; zebrafish; Drosophila larva; gender dimorphism; Hough transform; intermittant locomotion; saccades; undulatory swimming; SACCADIC MOVEMENT STRATEGY; DROSOPHILA; TRACKING; BEHAVIOR; PLATFORM; MANIPULATION; LOCOMOTION; NANCHUNG; HEARING; MOTION;
D O I
10.3389/fnbeh.2022.819146
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The analysis of kinematics, locomotion, and spatial tasks relies on the accurate detection of animal positions and pose. Pose and position can be assessed with video analysis programs, the "trackers. " Most available trackers represent animals as single points in space (no pose information available) or use markers to build a skeletal representation of pose. Markers are either physical objects attached to the body (white balls, stickers, or paint) or they are defined in silico using recognizable body structures (e.g., joints, limbs, color patterns). Physical markers often cannot be used if the animals are small, lack prominent body structures on which the markers can be placed, or live in environments such as aquatic ones that might detach the marker. Here, we introduce a marker-free pose-estimator (LACE Limbless Animal traCkEr) that builds the pose of the animal de novo from its contour. LACE detects the contour of the animal and derives the body mid-line, building a pseudo-skeleton by defining vertices and edges. By applying LACE to analyse the pose of larval Drosophila melanogaster and adult zebrafish, we illustrate that LACE allows to quantify, for example, genetic alterations of peristaltic movements and gender-specific locomotion patterns that are associated with different body shapes. As illustrated by these examples, LACE provides a versatile method for assessing position, pose and movement patterns, even in animals without limbs.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Markerless pose tracking for augmented reality
    Yuan, Chunrong
    ADVANCES IN VISUAL COMPUTING, PT 1, 2006, 4291 : 721 - 730
  • [2] Improving 3D Markerless Pose Estimation of Animals in the Wild using Low-Cost Cameras
    Muramatsu, Naoya
    da Silva, Zico
    Joska, Daniel
    Nicolls, Fred
    Patel, Amir
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 3770 - 3776
  • [3] MARKERLESS HUMAN MOTION CAPTURE AND POSE RECOGNITION
    Huo, Feifei
    Hendriks, Emile
    Paclik, Pavel
    Oomes, A. H. J.
    2009 10TH INTERNATIONAL WORKSHOP ON IMAGE ANALYSIS FOR MULTIMEDIA INTERACTIVE SERVICES, 2009, : 13 - +
  • [4] Improved Trajectory Reconstruction for Markerless Pose Estimation
    Cotton, R. James
    Cimorelli, Anthony
    Shah, Kunal
    Anarwala, Shawana
    Uhlrich, Scott
    Karakostas, Tasos
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [5] Towards markerless surgical tool and hand pose estimation
    Jonas Hein
    Matthias Seibold
    Federica Bogo
    Mazda Farshad
    Marc Pollefeys
    Philipp Fürnstahl
    Nassir Navab
    International Journal of Computer Assisted Radiology and Surgery, 2021, 16 : 799 - 808
  • [6] Common mechanics of mode switching in locomotion of limbless and legged animals
    Kuroda, Shigeru
    Kunita, Itsuki
    Tanaka, Yoshimi
    Ishiguro, Akio
    Kobayashi, Ryo
    Nakagaki, Toshiyuki
    JOURNAL OF THE ROYAL SOCIETY INTERFACE, 2014, 11 (95)
  • [7] Feature Points Selection for Markerless Hand Pose Estimation
    Morshidi, Malik Arman
    Tjahjadi, Tardi
    2015 INTERNATIONAL CONFERENCE ON SMART SENSORS AND APPLICATION - ICSSA 2015, 2015, : 133 - 138
  • [8] Markerless human pose estimation for biomedical applications: a survey
    Avogaro, Andrea
    Cunico, Federico
    Rosenhahn, Bodo
    Setti, Francesco
    FRONTIERS IN COMPUTER SCIENCE, 2023, 5
  • [9] Towards markerless surgical tool and hand pose estimation
    Hein, Jonas
    Seibold, Matthias
    Bogo, Federica
    Farshad, Mazda
    Pollefeys, Marc
    Furnstahl, Philipp
    Navab, Nassir
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (05) : 799 - 808
  • [10] Continuous body 3-D reconstruction of limbless animals
    Fu, Qiyuan
    Mitchel, Thomas W.
    Kim, Jin Seob
    Chirikjian, Gregory S.
    Li, Chen
    JOURNAL OF EXPERIMENTAL BIOLOGY, 2021, 224 (06):