Tracking Janus microswimmers in 3D with machine learning

被引:11
|
作者
Bailey, Maximilian Robert [1 ]
Grillo, Fabio [1 ]
Isa, Lucio [1 ]
机构
[1] Swiss Fed Inst Technol, Dept Mat, Lab Soft Mat & Interfaces, Vladimir Prelag Weg 5, CH-8093 Zurich, Switzerland
关键词
NANOPARTICLES; MICROSCOPY;
D O I
10.1039/d2sm00930g
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
Advancements in artificial active matter systems heavily rely on our ability to characterise their motion. Yet, the most widely used tool to analyse the latter is standard wide-field microscopy, which is largely limited to the study of two-dimensional motion. In contrast, real-world applications often require the navigation of complex three-dimensional environments. Here, we present a Machine Learning (ML) approach to track Janus microswimmers in three dimensions, using Z-stacks as labelled training data. We demonstrate several examples of ML algorithms using freely available and well-documented software, and find that an ensemble Decision Tree-based model (Extremely Randomised Decision Trees) performs the best at tracking the particles over a volume spanning more than 40 mu m. With this model, we are able to localise Janus particles with a significant optical asymmetry from standard wide-field microscopy images, bypassing the need for specialised equipment and expertise such as that required for digital holographic microscopy. We expect that ML algorithms will become increasingly prevalent by necessity in the study of active matter systems, and encourage experimentalists to take advantage of this powerful tool to address the various challenges within the field.
引用
收藏
页码:7291 / 7300
页数:10
相关论文
共 50 条
  • [21] MACHINE LEARNING AND 3D PRINTING JOIN FORCES
    不详
    ADVANCED MATERIALS & PROCESSES, 2018, 176 (08): : 80 - 80
  • [22] A 3D buffer memory for AI and machine learning
    Maarten Rosmeulen
    Nature Reviews Electrical Engineering, 2025, 2 (2): : 75 - 76
  • [23] Machine learning assisted sorting of active microswimmers
    Torrik, Abdolhalim
    Zarif, Mahdi
    JOURNAL OF CHEMICAL PHYSICS, 2024, 161 (09):
  • [24] Online appearance learning for 3D articulated human tracking
    Roberts, TJ
    McKenna, SJ
    Ricketts, IW
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL I, PROCEEDINGS, 2002, : 425 - 428
  • [25] Appearance learning for 3D tracking of robotic surgical tools
    Reiter, Austin
    Allen, Peter K.
    Zhao, Tao
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2014, 33 (02): : 342 - 356
  • [26] Tracking cell lineages in 3D by incremental deep learning
    Sugawara, Ko
    Cevrim, Cagri
    Averof, Michalis
    ELIFE, 2022, 11
  • [27] Online learning 3D context for robust visual tracking
    Zhong, Bineng
    Shen, Yingju
    Chen, Yan
    Xie, Weibo
    Cui, Zhen
    Zhang, Hongbo
    Chen, Duansheng
    Wang, Tian
    Liu, Xin
    Peng, Shujuan
    Gou, Jin
    Du, Jixiang
    Wang, Jing
    Zheng, Wenming
    NEUROCOMPUTING, 2015, 151 : 710 - 718
  • [28] 3d human motion tracking using manifold learning
    Guo, Feng
    Qian, Gang
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 357 - +
  • [29] Microswimmers with Heat Delivery Capacity for 3D Cell Spheroid Penetration
    Ramos-Docampo, Miguel A.
    Fernandez-Medina, Marina
    Taipaleenmaki, Essi
    Hovorka, Ondrej
    Salgueirino, Veronica
    Stadler, Brigitte
    ACS NANO, 2019, 13 (10) : 12192 - 12205
  • [30] 3D printed colloidal microswimmers with complex shapes propelled catalytically
    Le Ferrand, Hortense
    MRS BULLETIN, 2020, 45 (12) : 986 - 986