AlphaTracker: a multi-animal tracking and behavioral analysis tool

被引:7
|
作者
Chen, Zexin [1 ]
Zhang, Ruihan [2 ,3 ]
Fang, Hao-Shu [1 ]
Zhang, Yu E. [4 ,5 ]
Bal, Aneesh [6 ,7 ]
Zhou, Haowen [2 ]
Rock, Rachel R. [7 ]
Padilla-Coreano, Nancy [7 ,8 ]
Keyes, Laurel R. [7 ,9 ]
Zhu, Haoyi [1 ]
Li, Yong-Lu [1 ]
Komiyama, Takaki [5 ]
Tye, Kay M. [7 ,9 ]
Lu, Cewu [1 ,10 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Zhiyuan Coll, Shanghai, Peoples R China
[3] MIT, Media Arts & Sci, Cambridge, MA USA
[4] Univ Calif San Diego, Ctr Neural Circuits & Behav, Dept Neurobiol, La Jolla, CA USA
[5] Univ Calif San Diego, Dept Neurosci, La Jolla, CA USA
[6] Johns Hopkins Univ, Dept Psychol & Brain Sci, Baltimore, MD USA
[7] Salk Inst Biol Studies, La Jolla, CA 92037 USA
[8] Univ Florida, Dept Neurosci, Gainesville, FL USA
[9] Howard Hughes Med Inst, Salk Inst, La Jolla, CA 92093 USA
[10] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
来源
基金
国家重点研发计划;
关键词
neuroscience; computer vision; animal behavior; animal tracking; behavioral clustering;
D O I
10.3389/fnbeh.2023.1111908
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Computer vision has emerged as a powerful tool to elevate behavioral research. This protocol describes a computer vision machine learning pipeline called AlphaTracker, which has minimal hardware requirements and produces reliable tracking of multiple unmarked animals, as well as behavioral clustering. AlphaTracker pairs a top-down pose-estimation software combined with unsupervised clustering to facilitate behavioral motif discovery that will accelerate behavioral research. All steps of the protocol are provided as open-source software with graphic user interfaces or implementable with command-line prompts. Users with a graphical processing unit (GPU) can model and analyze animal behaviors of interest in less than a day. AlphaTracker greatly facilitates the analysis of the mechanism of individual/social behavior and group dynamics.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Laboratory Animal Tracking in Behavioral Experiments: An Alternative Low Cost Solution
    Kiziltan, Erhan
    Aydin, Leyla
    [J]. ACTA PHYSIOLOGICA, 2016, 218 : 77 - 77
  • [32] Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework
    Han, Yaning
    Chen, Ke
    Wang, Yunke
    Liu, Wenhao
    Wang, Zhouwei
    Wang, Xiaojing
    Han, Chuanliang
    Liao, Jiahui
    Huang, Kang
    Cai, Shengyuan
    Huang, Yiting
    Wang, Nan
    Li, Jinxiu
    Song, Yangwangzi
    Li, Jing
    Wang, Guo-Dong
    Wang, Liping
    Zhang, Yaping
    Wei, Pengfei
    [J]. NATURE MACHINE INTELLIGENCE, 2024, 6 (01) : 48 - 61
  • [33] Siamese Network-Based All-Purpose-Tracker, a Model-Free Deep Learning Tool for Animal Behavioral Tracking
    Su, Lihui
    Wang, Wenyao
    Sheng, Kaiwen
    Liu, Xiaofei
    Du, Kai
    Tian, Yonghong
    Ma, Lei
    [J]. FRONTIERS IN BEHAVIORAL NEUROSCIENCE, 2022, 16
  • [34] Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework
    Yaning Han
    Ke Chen
    Yunke Wang
    Wenhao Liu
    Zhouwei Wang
    Xiaojing Wang
    Chuanliang Han
    Jiahui Liao
    Kang Huang
    Shengyuan Cai
    Yiting Huang
    Nan Wang
    Jinxiu Li
    Yangwangzi Song
    Jing Li
    Guo-Dong Wang
    Liping Wang
    Yaping Zhang
    Pengfei Wei
    [J]. Nature Machine Intelligence, 2024, 6 : 48 - 61
  • [35] The EthoVision video tracking system - A tool for behavioral phenotyping of transgenic mice
    Spink, AJ
    Tegelenbosch, RAJ
    Buma, MOS
    Noldus, LPJJ
    [J]. PHYSIOLOGY & BEHAVIOR, 2001, 73 (05) : 731 - 744
  • [36] ANIMAL TRACKING IN OA RAT MODELS: A QUANTITATIVE TOOL FOR ACTIVITY REGISTRATION
    de Visser, H. M.
    Struik, T.
    Weinans, H.
    Mastbergen, S. C.
    Lafeber, F. P.
    [J]. OSTEOARTHRITIS AND CARTILAGE, 2015, 23 : A120 - A120
  • [37] Tracking Visitors in a Real Museum for Behavioral Analysis
    Rashed, Md Golam
    Suzuki, Ryota
    Yonezawa, Takuya
    Lam, Antony
    Kobayashi, Yoshinori
    Kuno, Yoshinori
    [J]. 2016 JOINT 8TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 17TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2016, : 80 - 85
  • [38] Wireless Indoor Tracking of Livestock for Behavioral Analysis
    Asikainen, Mikko
    Haataja, Keijo
    Toivanen, Pekka
    [J]. 2013 9TH INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING CONFERENCE (IWCMC), 2013, : 1833 - 1838
  • [39] Automatic tool for behavioral analysis based on statement analysis
    [J]. 1600, Politechnica University of Bucharest (79):
  • [40] Digital Video Acquisition and Optimization Techniques for Effective Animal Tracking in Behavioral Ecotoxicology
    Henry, Jason
    Bai, Yutao
    Wlodkowic, Donald
    [J]. ENVIRONMENTAL TOXICOLOGY AND CHEMISTRY, 2022, 41 (10) : 2342 - 2352