Reinforcement learning of biomimetic navigation: a model problem for sperm chemotaxis

被引:1
|
作者
Mohamed, Omar [1 ]
Tsang, Alan C. H. [1 ]
机构
[1] Univ Hong Kong, Dept Mech Engn, Pokfulam Rd, Hong Kong, Peoples R China
来源
EUROPEAN PHYSICAL JOURNAL E | 2024年 / 47卷 / 09期
关键词
FLUID SHEAR; EVOLUTION; FLOW;
D O I
10.1140/epje/s10189-024-00451-6
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
Motile biological cells can respond to local environmental cues and exhibit various navigation strategies to search for specific targets. These navigation strategies usually involve tuning of key biophysical parameters of the cells, such that the cells can modulate their trajectories to move in response to the detected signals. Here we introduce a reinforcement learning approach to modulate key biophysical parameters and realize navigation strategies reminiscent to those developed by biological cells. We present this approach using sperm chemotaxis toward an egg as a paradigm. By modulating the trajectory curvature of a sperm cell model, the navigation strategies informed by reinforcement learning are capable to resemble sperm chemotaxis observed in experiments. This approach provides an alternative method to capture biologically relevant navigation strategies, which may inform the necessary parameter modulations required for obtaining specific navigation strategies and guide the design of biomimetic micro-robotics.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Autonomous vehicle navigation by reinforcement learning with problem structure identification
    Naruse, K
    Leu, MC
    INTELLIGENT AUTONOMOUS SYSTEMS: IAS-5, 1998, : 226 - 233
  • [2] DEVS MODEL CONSTRUCTION AS A REINFORCEMENT LEARNING PROBLEM
    David, Istvan
    Syriani, Eugene
    PROCEEDINGS OF THE 2022 ANNUAL MODELING AND SIMULATION CONFERENCE (ANNSIM'22), 2022, : 30 - 41
  • [3] A fully integrated biomimetic microfluidic device for evaluation of sperm response to thermotaxis and chemotaxis
    Yan, Yimo
    Zhang, Boxuan
    Fu, Qiqi
    Wu, Jian
    Liu, Ran
    LAB ON A CHIP, 2021, 21 (02) : 310 - 318
  • [4] Trajectory Tracking and Navigation Model for Autonomous Vehicles Using Reinforcement Learning
    Ramani, G.
    Karthik, C.
    Pranay, B.
    Pramodh, D.
    Reddy, B. Karthik
    ARTIFICIAL INTELLIGENCE AND KNOWLEDGE PROCESSING, AIKP 2023, 2024, 2127 : 127 - 145
  • [5] A UNIFYING MODEL FOR SPERM CHEMOTAXIS TO EGG PEPTIDES
    COOK, SP
    BROKAW, CJ
    MULLER, CH
    BABCOCK, DF
    FASEB JOURNAL, 1993, 7 (07): : A1248 - A1248
  • [6] Reinforcement learning strategies for vessel navigation
    Daranda, Andrius
    Dzemyda, Gintautas
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2023, 30 (01) : 53 - 66
  • [7] NOVEL MODEL FOR STUDY OF HUMAN SPERM CHEMOTAXIS
    VILLANUEVADIAZ, C
    ARIASMARTINEZ, J
    BUSTOSLOPEZ, H
    VADILLOORTEGA, F
    FERTILITY AND STERILITY, 1992, 58 (02) : 392 - 395
  • [8] Inertial Navigation Compensation with Reinforcement Learning
    Bozeman, Eric
    Minhdao Nguyen
    Alam, Mohammad
    Onners, Jeffrey
    2022 9TH IEEE INTERNATIONAL SYMPOSIUM ON INERTIAL SENSORS AND SYSTEMS (IEEE INERTIAL 2022), 2022,
  • [9] Reinforcement Learning in Navigation and Cooperative Mapping
    Cruz, Jose Aleixo
    Cardoso, Henrique Lopes
    Reis, Luis Paulo
    Sousa, Armando
    2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020), 2020, : 200 - 205
  • [10] A topological reinforcement learning agent for navigation
    Braga, APS
    Araújo, AFR
    NEURAL COMPUTING & APPLICATIONS, 2003, 12 (3-4): : 220 - 236